RESPONSABILITIES
-
Use of Databricks for transformation and loading of the data in the different layers
-
Use of Spark/Python for the development of the libraries
-
Use of Azure DevOps pipelines to automate the CI/CD
-
Participate in the development of the dataset and incorporate new sources from the data lake
-
Develop best practices on the data quality validation
REQUIREMENTS
Professional Experience
-
4 years in the development in spark/python
-
4 years on databricks
-
2 years on Azure DevOps
-
1 year PowerShell Experience on Azure data lake
-
Experience on data factory
Soft Skills
-
Strong interpersonal, teamwork, coordination, and consensus-building skills
-
Strong communication, documentation, storytelling, creativity, and presentation skills
-
Strong organizational skills, the ability to perform under pressure, and to manage multiple priorities with competing demands
Language
Bilingual (French & English) with excellent verbal and written communication skills