Lead Data Engineer - AWS, Python

Job Description

Technical Lead Data Engineer to join a cutting-edge Greentech company in London (Hybrid) to help build and maintain scalable, reliable, and secure data pipelines that power their BI, analytics, and machine learning applications.

Benefits

• Generous stock options
• Support from a diverse team of ClimateTech industry experts and enthusiasts
• A flexible and remote working environment, with occasional travel to London (2 days per fortnight)
• A chance to work on cutting-edge data projects that have a real impact on the climate and the future of mobility
• Full package: pension, healthcare, perkbox, the usual startup benefits

Responsibilities

• Leading small team of Data Engineers
• Working with large and complex datasets from various sources, such as IoT sensors, smart meters, weather data, and customer feedback
• Using AWS cloud services, such as S3, Lambda, Glue, Athena, Redshift, and Kinesis, to design, develop, and deploy data solutions that meet the needs of stakeholders
• Using Python and other programming languages to write high-quality code, perform data cleansing, transformation, and validation, and implement best practices for data quality and governance

Requirements

• At least 5 years of experience as a data engineer or a similar role, working with large-scale data systems and pipelines
• Proficient in AWS cloud technologies and services, especially those related to data engineering and analytics as above
• Good knowledge of dbt, Airflow, or Kafka, Snowflake, MongoDB, Redshift or equivalent
• Proficient in Python and other programming languages, such as SQL
• Familiar with data modelling, data warehousing, and data lake concepts and architectures
• Excellent communication, collaboration, and problem-solving skills