Skip to main content

Python PySpark Developer

Python PySpark Developer
Ampstek
1 year ago

Job Opportunity Details:

Role Title: Python Pyspark developer

Location: Munich, Germany(Hybrid)

Required Core Skills:

  • Python
  • PySpark
  • SQL
  • Shell scripting
  • Linux commands

Any of these Database: Oracle, Postgre SQL, MS SQL Server, MongoDB

Requirement Analysis

Incident Management

Development and testing

Nice to have skills: Java 7/8

Minimum years of experience: 5 - 7 years

Areas of Responsibility / Detailed Job Description:

  • Talent will need to work as a lead at onsite
  • Should be able to perform data integration with cross platforms
  • Should be able to setup data connections from various source
  • Should be able to build transform in SQL or PySpark/Python
  • Should be able to build data pipelines using pipeline builder or code repositories
  • Should be able to configure and setup/manage Middleware agents on Linux so need to have knowledge on Linux system and commands
  • Should be able to debug check, build failures which requires understanding in spark framework and java to optimize the failures
  • Should be able to administer platform, which involves whitelisting endpoints, ingress/egress policy setup, SAML config/management/migration, role setup, organization permission setup
  • Should be able to perform Governance operations which involves PII data identification/rectification, access approval setup
  • Should be able to perform security operations which involve vulnerability fixes, resource management on servers
  • Should be able to support ontologies and other data pipelines

Contact Details:

  • Durga Prasad M | Technical Recruiter
  • UK/EU Ampstek LLC
  • Mail ID: prasad.m@ampstek.com
  • Direct: +48 (22) 1857586
  • LinkedIn ID: linkedin.com/in/durga-prasad-m-a93170246

Expertise level

Work arrangement

Key skills

Similar Jobs in Germany