Senior Data Engineer - Big Data, Python, Databricks

JOB DESCRIPTION

We are hiring highly enthusiastic Python/Databricks engineers to create, tune, maintain and build reporting for the Big Data platforms that drive their retail business. This role is key to the Company's continued market dominance, and requires people that are passionate about data and seeking perfection in their development.

REQUIREMENTS

• Performing systems integration design and development in cloud architecture design (Azure)
• Building sizing and cost models for Cloud Services (Azure)
• Review enhancement requests and recommend best solution to stakeholders as SME
• Containerizing ingestion processes using docker and kubernetes services
• Understand business requirements to design, build, develop and test data integration pipelines
• Plan, direct DevOps implementation and system hardware/software updates for better performance, stability
• Work on the BI dashboards to support retail stores and the Azure AI platform that runs the personalized consumer experiences used by millions each day

EDUCATION AND EXPERIENCE

• EDUCATION: Bachelors/4 Yr Degree
• YEARS OF RELEVANT WORK EXPERIENCE: 7+Years

SPECIFIC KNOWLEDGE AND SKILLS

• 5+ years or demonstrated mastery of dvelopment with programming laugages - Python, SQL, Unix
• 2+ years experience with Apache Spark and Databricks cloud tool sets (AWS or Azure)
• 1+ years experience with GCP/Azure Cloud Big Data tools (PowerBI/DataLake/ Azure Databricks)
• Self-motivated with excellent analytical, problem solving, verbal and communication skills
• Proficiency in API security frameworks, token management and UAC including OAuth, JWT, etc
• Basic knowledge of using Devops, Github, JIRA tools and ability to work in agile environment
• Bachelos degree - Computer Science or equivalent
• Open Source Development experience is a bonus