Python Data Engineer

Job Description

Position Description:

• Machine Learning: Python Pyspark, PYTorch
• Machine learning modeling experience.
• Python scripting expertise.
• MLOps experience.

Data Engineer

Data Engineer having 6-10 years of experience in:

• ETL.
• Data Ingestion.
• Implementation of data warehousing and Data Lake solutions.

Strong skills:

• PySpark/Python programming - Partitioning, parallel distributed computation, and spark cluster concepts.
• Optimization for loading and processing ETL of large data sets.
• Strong SQL programming skills - Ability to write SQL queries (Joins, Unions, Group by, and Sub queries).

Experience in:

• Azure Cloud.
• Preferable Dataiku experience in building data-preparation and model flows to optimize the code and productionize the flows.
• Relational database experience (experience with Snowflake is a big plus).
• Some experience in Azure Databricks.