Python PySpark Developer

Job Details

Location: Munich, Germany (Hybrid)

Experience: 5+ Years

Skills: Python, PySpark, SQL, Shell scripting, Linux command & Any of these Database (Oracle, Postgre SQL, MS SQL Server, MongoDB)

Responsibility:

Responsibilities Overview:

• Talent will need to work as a lead at onsite
• Should be able to perform data integration with cross platforms
• Should be able to setup data connections from various sources
• Should be able to build transforms in SQL or PySpark/Python
• Should be able to build data pipelines using pipeline builder or code repositories
• Should be able to configure and setup/manage Middleware agents on Linux so need to have knowledge on Linux system and commands
• Should be able to debug check, build failures which requires understanding in spark framework and java to optimize the failures
• Should be able to administer platform, which involves whitelisting endpoints, ingress/egress policy setup, SAML config/management/migration, role setup, organization permission setup
• Should be able to perform Governance operations which involves PII data identification/rectification, access approval setup
• Should be able to perform security operations which involve vulnerability fixes, resource management on servers
• Should be able to support ontologies and other data pipelines

Contract

• 9 Months + Extension