Python Data Engineer

Data Engineer Job Description

The ideal candidate will be responsible for designing, implementing, and maintaining data pipelines and systems to support our data infrastructure. The role involves collaborating with data scientists, analysts, and software engineers to ensure efficient data processing and integration. The Python Data Engineer will also contribute to optimizing data workflows, ensuring data quality and reliability, and implementing best practices for data management and governance.

Requirements:

• Strong programming skills in Python
• Experience with data processing frameworks (such as Pandas, NumPy, or Spark)
• Proficiency in SQL
• Experience with cloud platforms
• Familiarity in big data technologies

Skills:

Primary Skills: Python, Pandas, SQL, NoSQL, Data Cleaning, EDA

Secondary Skills: Snowflake, Vector DBs, HPC, Neo4j

Additional Information:

• Data Engineer should have experience in EDA for ML projects
• Python with PyTorch is good to have
• Neo4J is preferred
• Snowflake is optional

Role Overview

Individual Contributor