Data Architect

Job Descriptions

Software Engineer responsible for developing and maintaining data processing application which will handle data from small to large volumes in terabytes of business critical enterprise data.

• Must have 4+ years of developing data centric application using Spark/Scala or Python running on EMR or AWS Glue.
• Must have data pipeline orchestration experience using self created pipelines or using AWS step functions handling pipeline using Python based AWS Lambda.
• Must have 3+ years’ experience in utilizing AWS cloud service.
• 4+ years of experience in CICD pipeline

Project

This is data space EDML.

• Large volume Data transformation within AWS

Requirement

• Somebody working on High volume Data environment.
• AWS glue, S3, Lambda, Fargate/ECS, Step functions
• Scala then Python then for data processing Spark.SQL for Data transformation.
• A person would be coming from Automation testing mid-set.

Must-Have

• Scala, Python, AWS (Glue, S3, Lambda, Fargate/ECS, Step Functions), SQL