Senior Big Data Engineer

Title: Sr. BigData Engineer (Hadoop/AWS, Python)

Location

• New York, NY / Raleigh,NC (Day 1 onsite - Hybrid)

Duration

• 6+ Months (Possibility of Extension)

Implementation Partner

• Infosys

End Client

• To be Disclosed

Jd

Over 9+ years of experience

• 9+ yrs IT experience and good expertise in SDLC/Agile
• 5+ yrs in Big Data technologies Hadoop, AWS, Python, Scala, Kafka, Spark etc

Mandatory

Good listing skills to understand business objectives and collaborate well with team and business partners

• Proficient in data consolidation/flattening, optimizing 'Big-Data' pipelines, architecture, and large data sets.
• Hands on experience in writing complex queries on data sets in Hadoop and mongoDB
• Good experience in implementing Kafka, spark streaming, Mongo db and Shell scripting
• Hands on experience in migrating Hadoop on-prem to cloud AWS/Snowflake
• Enable/recommend proactive measures to enhance data quality and improve SLA of Production components

Desired

• Design and develop python flex APIs