Senior Cloud Data Engineer

Job Description

Our client is Canada's largest retailer. They are looking for a Sr Cloud Data Engineer (GCP) with SQL, airflow/dataflow to pipe data and build out our clients enterprise data lake in a CI/CD environment.

Duration: Until End of year to start - strong possibility of extension

Location: Brampton/Toronto (Hybrid; 3 days onsite)

Project

• Build pipelines through our client's data lake going to our client's marketing insights tool.
• 27 data sources that must land in the data lake - run through remediation and apply the logic
• Work with data analysts - understand how to land the data .. The Data Engineer will build the orchestration and pipe the data through and build out the data lake

Must Haves

• GCP
• SQL, and Python or Java
• Build, pipelines, tables and objects (within Data lake) and document it.
• Dataflow or Airflow (schedule, montitor processes/data processing)