Job Details
- Job Title: Lead Python AWS Developer
- Job Category: Software Development/ Engineering
- Location: Remote, United States
Description
CGI has an immediate need for an Lead Python/AWS Developer to join our financial services team in Columbia, SC, Knoxville, TN or Plano, TX. Due to the current COVID-19 status, candidates will not be required to work within the physical work location at this time. When COVID-19 restrictions are lifted, they will be required to be located within the proximity of the assigned CGI location.
This is an exciting opportunity to work in a fast-paced team environment supporting one of the largest leaders in the secondary mortgage industry. We take an innovative approach to supporting our client, working side-by-side in an agile environment using emerging technologies.
Position Description
Design the architecture for migrating on-premise data warehouse and data marts to the data lake and subsequent vending on AWS Cloud.
Architect solutions for the design and implementation of Big & Fast Data Infrastructure on AWS cloud using Kafka, Glue, Athena, Redshift, DynamoDB.
Guide other teams to design, develop, and deploy data sets and tools that support product use cases.
Your Future Duties And Responsibilities
- Very strong Python development experience where the candidate has worked on several features that are pushed to production (more than 5 years).
- Spark knowledge and PySpark development experience (hands-on coding) which includes deploying to EMR or Glue around 3+ years.
- Working experience with Lambda, Step functions, SQS & SNS (minimum 2 years).
- Hands-on development experience using IDE (PyCharm, IntelliJ, Eclipse, etc) 5+ years.
- Good knowledge of ETL process.
- Should have deployed his project to PROD and preferably done some PROD support.
Required Qualifications To Be Successful In This Role
- 12+ years of relevant experience.
- Must have AWS data AND application experience.
- Should Be Strong In
- AWS serverless services (Lambda, Step function, batch) AWS Big data service (EMR, ECS) AWS Storage services (S3) AWS Database services (Glue catalog, Redshift) AWS deployment service (CodeCommit, Code pipeline, CloudFormation) PyMust have 5+ Python Development experience SQL Testing and debugging experience on AWS Linux and shell script.
- Database systems (SQL and NoSQL).
- Data warehousing solutions.
- ETL tools.
- Data APIs.
- Understanding the basics of distributed systems.
- Knowledge of algorithms and data structures.
- Have worked in a Lead position.
- Excellent communication.
Desired Skillset
AWS Solutions Architect, AWS Developer certifications.
Educational Requirements
Bachelor's degree in computer science, Information Systems or related field.
Skills
- ETL - 8 year(s).
- Linux - 8 year(s).
- Shell ScriptSQL.