Skip to main content

Senior Big Data Engineer

Senior Big Data Engineer
Capgemini Engineering
6 months 2 weeks ago

About Capgemini Engineering

Capgemini Engineering is a world leader in engineering and R&D services. They combine broad industry knowledge and cutting-edge technologies in digital and software to support the convergence of the physical and digital worlds.

Every day, they help clients accelerate their journey towards Intelligent Industry. With a 55-year heritage and deep industry expertise, Capgemini is trusted by clients to address the entire breadth of their business needs—from strategy and design to operations.

Capgemini Engineering provides premium Software Engineering services to leading technology companies, offering team extension as the engagement model that works best.

The Client and the Project

The client is a global visual inspiration social media platform used by people around the world. The project involves large-scale Data processing on one of the world's largest social media platforms, dealing with petabytes of data daily. The aim is to investigate, create, and implement solutions for technical challenges using cutting edge technologies, and to contribute to the effective functioning of the software used by hundreds of millions of users.

The Team and Responsibilities

  • Team Structure: The team is an international one, divided into Scrum teams consisting of 5-7 people.
  • Responsibilities:
    • Obtaining tasks from the project lead or Team Lead (TL), preparing and designing specifications, and approving them with all stakeholders.
    • Ensuring that assigned tasks are executed within set deadlines and required quality objectives.
    • Providing estimations and contributing to the project plan or the assigned area.
    • Analyzing the scope of alternative solutions and making decisions about the implementation area based on experience and technical expertise.
    • Leading the functional and architectural design of the assigned areas, ensuring design decisions meet architectural and design requirements.
    • Addressing risks, providing and implementing mitigation plans.
    • Initiating and conducting code reviews, creating code standards, conventions, and guidelines.
    • Suggesting technical and functional improvements to add value to the product.

Expectations and Requirements

  • Expectations:
    • Extensive experience as Big Data Engineer.
    • Solid Python and Java coding skill.
    • Knowledge of JavaScript and/or GO.
    • Established big-data systems experience in Hadoop, Spark/SparkSQL, HiveSQL.
    • Experience with large-scale graph data storage.
    • Strong OOP skills.
    • Effective communication, collaboration, and interpersonal skills.
    • Result oriented approach.
  • Nice to have:
    • Experience with Airflow, Apache Atlas.
    • Experience with AWS.
    • Experience with Kafka.

Benefits and Development Opportunities

  • Benefits:
    • Flexible working hours.
    • Equipment package for home office.
    • Private medical care and life insurance with ability to buy additional packages on preferential terms.
    • Access to Capgemini Helpline with possibility to chat with therapists.
    • Bonuses for recommending friends to Capgemini.
    • Access to Inspiro app with rich audiobooks database.
    • Access to our NAIS benefit platform with 40+ options available.
  • Development:
    • 70+ training tracks with certification opportunities on the NEXT training platform.
    • Platform with free access to Pluralsight, TED Talks, Coursera materials and trainings.
    • Free access to Udemy Business account with ability to use during and outside working hours.
    • Transparent performance management policy.
  • Atmosphere:
    • Emphasis on teamwork and good relationships.
    • No official dress-code.
    • Various communities: OUTfront, Women@Capgemini, Foreigners Community, and more.
    • Day off for volunteering.
    • Ability to implement world-changing initiatives thanks to the Grant Program.

More About Capgemini Engineering

Capgemini Engineering has 65,000 engineer and scientist team members in over 30 countries across sectors including Automotive, AI and Data, Software & Internet, Telecommunication, Rail, Infrastructure and Transportation, Defense, Aeronautics, Energy, Communications, Semiconductor & Electronics, Industrial & Consumer. Join them on a journey towards Intelligent Industry!

Join Capgemini Engineering

It's time to #Get the Future You Want! Your life is in your hands, and you have the opportunity to improve it, develop yourself, and simply—join Capgemini Engineering. Do you want to get to know Capgemini Engineering better? Visit their website or check their social media profiles on Instagram, Facebook, and TikTok.

Expertise level

Work arrangement

Similar Jobs in Poland

Similar Jobs in Mazowieckie

Similar Jobs in Warsaw