Position: Tech Lead- Python + Spark (PySpark)

Location: Palo Alto, CA (Onsite from day 1)

Duration: Contract/Fulltime

Job Description

10+ years of total experience with application development using Python + Spark (PySpark)
Proficient in AWS Cloud (especially services around AWS BigData/Analytics)
Good understanding on AWS networking (VPC) for connectivity between jobs running in AWS VPC and other Cloud services (e.g. Cloud Data Stores)
Proficiency with bulk operations (data load and unload) on databases and warehouses, expertise on big data projects
Expertise with ETL/Big Data concepts understanding
Good in Apache Spark platform
Good articulation / communication skills to brainstorm ideas with offshore team and also discuss/pass thoughts with AWS team.
Good database understanding (RDBMS and also Bigdata)
Good requirements understanding
Data warehousing, analytics domain understanding
Skills to ramp up on new databases (as per the connectors)
Source code versioning using GIT
CI/CD using Jenkins/Gitlab/AWS services