Senior Lead Python Engineer with Apache Spark

We are seeking a highly skilled and experienced Senior or Lead Software Engineer

with expertise in Python and Apache Spark as well as demonstrable experience building data processing systems using structured data for our client, a leading wholesale provider of reinsurance, insurance and other insurance-based forms of risk transfer.

It is a fully remote position offering you the flexibility to work from any location in Poland, whether it's your home or one of our well-equipped offices in Gdansk, Katowice, Krakow, Lodz, Warsaw, or Wroclaw.

SEE YOURSELF IN THIS ROLE

As Senior/Lead Python Software Engineer you will join a team responsible for the data integration, transformation, modelling and serving of large amounts of structured financial data. We strive to apply software engineering processes and principles to data engineering.

What You’ll Do

• Design and build software that processes data through our medallion architecture running on Databricks in Microsoft Azure using Python and Apache Spark
• Apply relational data modeling skills and SQL knowledge in handling various data tasks efficiently
• Maintain an active role in every part of the software development lifecycle - from idea generation to deployment
• Facilitate open lines of communication to discuss project requirements, challenges, and solutions
• Contribute to the constant improvement of the software development lifecycle through your knowledge and ideas
• Troubleshoot any issues during the development process, providing timely and effective solutions

What You Have

• Minimum 3-5 years of Python engineering experience
• Demonstrable experience building data processing systems using structured data, preferably using Apache Spark
• Good relational data modelling skills and SQL skills
• Ability and drive to work across the whole software development lifecycle (understanding requirements, contributing to designs, writing code, writing automated tests, providing production support, helping with deployments)
• Very good English communication skills both written and verbal

Nice to have

• Experience with Databricks and Azure Delta Lake Analytics is an advantage

We Offer

• We gather like-minded people:
  • Friendly team and enjoyable working environment
  • Engineering community of industry’s professionals
  • Flexible schedule and opportunity to work remotely within Poland
  • Chance to work abroad for up to 60 days annually
  • Relocation within our 50+ offices
• We provide growth opportunities:
  • Outstanding career roadmap
  • Leadership development, career advising, soft skills and well-being programs
  • Certification (GCP, Azure, AWS)
  • Unlimited access to LinkedIn Learning, Get Abstract, O’Reilly, Cloud Guru
  • Language classes on English and Polish for foreigners
• We cover it all:
  • Stable income (Employment Contract or B2B)
  • Participation in the Employee Stock Purchase Plan
  • Referral bonuses
  • Benefits package (health insurance, multisport, shopping vouchers)
  • Corporate and social events

About EPAM

• EPAM is a leading global provider of digital platform engineering and development services. We embrace a dynamic and inclusive culture, where you will collaborate with multi-national teams, contribute to a myriad of innovative projects, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential