Senior Python Developer - AWS Cloud Automation

Job Details

• REQ ID: 33235808
• ROLE: Sr. Python Developer Automation Script Developer (AWS Cloud)
• LOCATION: Cupertino, CA - Hybrid
• MAIN SKILLS: Very strong on Python, AWS Cloud, Google Cloud Storage, data platforms, ETL pipelines, data analytics, Object-oriented programming Java, Spark and Kafka, Data Catalog tools like DataHub

Responsibilities

Tasks assigned in this role involve software engineering skillset related to analysis, coding, and mapping from source to destination. Periphery tasks related to data engineering will also be assigned as needed.

Experience

• Experience with GCS is preferred as data is stored there for ingestion.
• Must have experience writing test cases and unit testing.

Required Skills

• Strong Python skills for scripting and automation.
• Experience with writing and maintaining scripts for ingesting metadata on different storage platforms.
• Ability to integrate scripts within pipelines for fully automated solutions.
• Excellent knowledge of test case creation and implementation, including end-to-end regression suites for APIs.
• Google Cloud Storage (GCS) experience is preferred.
• Familiarity with data platforms, ETL pipelines, and data analytics.
• Expertise in Object-oriented programming with Java.
• Experience with distributed systems like Spark and Kafka.
• Experience with Data Catalog tools like DataHub.
• Understanding of AWS Cloud services like S3, RDS, IAM, Docker, Kubernetes.
• Experience with deployment tools like Terraform.
• Understanding of version control with Git and CI/CD workflow.
• Understanding of file formats like Parquet and Avro.
• Strong skills in debugging and troubleshooting.