Responsibilities
Collaborate with cross-functional teams to understand the existing pricing system's intricacies and pain points, identifying areas for improvement.
Design and implement a robust data movement strategy from diverse sources to the new "PriceFx" ecosystem using Azure Data Factory.
Develop and optimize ETL pipelines using Azure Data Factory to ensure seamless and reliable data integration.
Leverage Azure Databricks for data processing, transformation, and analysis, driving insights that fuel the pricing decision-making process.
Architect and implement PYTHON-based API extensions, with a focus on scalability, performance, and security.
Work closely with data scientists and analysts to develop algorithms and models that enhance the accuracy of pricing calculations.
Collaborate with the development team to ensure Python/Flask-based APIs are seamlessly integrated into the overall ecosystem.
Provide technical leadership, mentoring, and guidance to team members, fostering a culture of innovation and excellence.
Stay updated with the latest industry trends and technologies related to Azure, data engineering, and pricing analytics.
Required Qualifications
- Solid experience with the Azure ecosystem, particularly Azure Data Factory and Azure Databricks.
- Proficiency in designing and implementing ETL pipelines for data movement and transformation.
- Strong Python programming skills, including experience with Flask or similar frameworks for API development.
- Deep understanding of pricing analytics and the automotive industry's pricing dynamics is a strong plus.
- Familiarity with cloud-based data storage solutions and data lakes.
- Excellent problem-solving skills and the ability to dissect complex issues to find optimal solutions.
- Strong communication skills to collaborate effectively with both technical and non-technical stakeholders.
- Experience with version control systems and collaborative development workflows.
- Proven track record of delivering high-quality solutions on time and within scope.
Value added Qualification
- Relevant certifications in Azure, such as Microsoft Certified: Azure Data Engineer Associate or similar.
- Prior experience in building pricing solutions or analytics platforms for the automotive industry.
- Knowledge of data privacy and security best practices when handling sensitive pricing data.
- Familiarity with machine learning concepts and integration of ML models into production systems.