Job Opening: Data Engineer with Python & Spark

Location : Chicago, IL / Dallas, TX/ Princeton, NJ/ Atlanta, GA (Hybrid)

Duration : Fulltime

5 + years of experience in Data pipeline engineering for both batch and streaming applications & should have hands on experience in AWS cloud
Experience with data ingestion process, creating data pipelines (should be able to move data between stages in data lake, apply transformation rules) and performance tuning. Must be hands-on coding using Python with Spark.
Exposure working with complex data types like XML or JSON, CI/CD pipeline and scheduling tools like Airflow.
Proven experience in DWH (type-2 dimensions, aggregations, star schema, etc.) design and implementation
Proficient in writing complex SQL queries
Effective communication and collaboration skills to work with cross-functional teams and stakeholders.
Oversee and monitor the work of offshore according to projects timelines and, if necessary, resolve any issues as they arise.

Data Engineer with Python & Spark