Python/DataBricks Developer

Job Description

Our Client needs highly enthusiastic Python/Databricks engineers to create, tune, maintain and build reporting for the Big Data platforms that drive their retail business.

Key responsibilities

• Performing systems integration design and development in cloud architecture design (Azure)
• Building sizing and cost models for Cloud Services (Azure)
• Review enhancement requests and recommend best solution to stakeholders as SME.
• Containerizing ingestion processes using docker and kubernetes services.
• Understand business requirements to design, build, develop and test data integration pipelines.
• Plan, direct DevOps implementation and system hardware/software updates for better performance, stability.
• Work on the BI dashboards to support retail stores and the Azure AI platform that runs the personalized consumer experiences used by millions each day.

Knowledge and Skills

• 5+ years or demonstrated mastery of development with programming languages - Python, SQL, Unix.
• 2+ years experience with Apache Spark and Databricks cloud tool sets (AWS or Azure).
• 1+ years experience with GCP/Azure Cloud Big Data tools (PowerBI/DataLake/Azure Databricks).
• Self-motivated with excellent analytical, problem solving, verbal, and communication skills.
• Proficiency in API security frameworks, token management and UAC including OAuth, JWT, etc.
• Basic knowledge of using DevOps, Github, JIRA tools and ability to work in an agile environment.
• Bachelor's degree - Computer Science or equivalent.
• Open Source Development experience is add on.