Data Engineer
DataKitchen Albert Heijn is a renowned supermarket chain that has been serving customers across the Netherlands for over 135 years. Founded in 1887 by Albert Heijn, the company has grown to become one of the most trusted and beloved grocery retailers in the country. With a commitment to quality, convenience, and customer satisfaction, Albert Heijn has become an integral part of the Dutch community's daily lives. Albert Heijn is accelerating in becoming a Food and Tech Company. That is where AH Technology comes into the picture. With a focus on Data, Digital and Tech, we at Albert Heijn strive to deliver high quality products where technology plays an important role.
Job Description
Part of AH Technology is the Data Differentiation Platform (DDP), where we support the Cloud Services and Data Management within Albert Heijn and deliver THE groundbreaking self-service data platform, called Thor, designed to empower Data Producers and Data Consumers. With Thor, the process of data ingestion, transformation, and utilization becomes seamless, enabling users to unlock the full potential of their data while ensuring compliance with privacy regulations, including handling sensitive information like PII (Personally Identifiable Information).
Till now, teams within DDP have been ingesting the data of the Data Producers into the data platform, supporting the Data Consumers with accessing the data and even creating datasets for them. This is changing in the coming months, where we move towards our new Data Strategy.
So, what is the change you might think? Well, as stated Thor is designed to empower Data Producers and Data Consumers, meaning that Data Producers can onboard their own data in a Self-Service manner, without having a dedicated team within DDP doing this for them. This makes the data flow easier, where a Data Consumers requests the data to the Data Producers, and they ensure it's delivered for them.
Besides ensuring that data ingestion gets easier, DDP is also working on various enablement blocks on the data platform, to make the life of our Consumers easier when it comes to data preparation for data products they work on. You can think of having a standardized package that builds up a DataMart in a few clicks. It is not there yet but soon to come!
Your Responsibilities
- Work closely together with the DataKitchen Data Engineers in expanding the foundation for the DataMart Engine
- Support the Product Owner with stakeholder management
- Ensure the DataMart is being built in such manner that it’s a (versioned) package we can deliver, as we won’t be owning the DataMart
- Train others in making right usage of DataMart engine
- Ensure alignment with architecture and data strategy is there at all times
- Keep building the product in a scalable and cost effective manner
- Ensure the product meets all security guidelines
- Implement observability with proactive monitoring/alerting
- Changes of DataKitchen engine version made available via pull mechanism
Requirements
- >7 years’ work experience as a Data Engineer
- Experience with Cloud platforms (Microsoft Azure)
- Experienced with Databricks
- Very experienced with Python/SQL/PySpark
- Experienced in running bigger projects and scaling them
- Understanding concepts of Data Modelling, Orchestration and Observability
- Strong communication and teamwork skills, with the ability to effectively collaborate with both technical and non-technical stakeholders
- Lives in Netherlands and can work from Zaandam office minimum 2 days a week, more if required
What we offer
- An annual salary up to 95k including holiday allowance and a flexible bonus. Depending on your level of seniority and experience
- A minimum of 20 days paid vacation, optionally 12.5 days extra.
- Flexible working hours
- Access to a challenging training curriculum – AH Tech Academy
- An excellent pension plan where we as an employer contribute 6 times more than you as an employee
- A travel allowance or a NS-business card for traveling to and from Zaandam by train
- 10% staff discount on groceries in all Albert Heijn stores, to a maximum of €300 per year
- A free Mijn Albert Heijn Premium membership with many benefits
- A company laptop and telephone