Skip to main content

Senior Big Data Engineer

Senior Big Data Engineer
Capgemini
9 months 2 weeks ago

Short Description

  • Performs research, design, implementation and support tasks as a member of Capgemini team. Works in accordance with project guidelines, quality standards and code conventions.
  • Responsible for area/areas within the team area of responsibility (AOR). One of the current team AOR is implement high-performance graph storage solution, integrate listeners into systems like Hadoop, Spark, and internal tools to produce graph nodes and vertices and help build visualizations and traversals of the graphs.
  • Investigate, create, and implement the solutions for existing technical challenges, including building/enhancing the frameworks and tools used by other development teams

Qualifications

Must have:

  • University degree in Computer Related Sciences or similar
  • 5+ years of solid code profiling experience in Python
  • Big Data tools: Hive, Presto, Spark (pySpark, SparkSQL), Apache Airflow, Apache Iceberg
  • Data file formats: Parquet
  • Docker, K8s, Git
  • Proficiency in both SQL databases and NoSQL databases
  • Knowledge of data warehousing concepts and tools
  • Familiarity with big data processing frameworks like Apache Spark
  • Proficiency in distributed computing and parallel processing
  • Ability to organize and document solutions.
  • A passion for streamlining systems and processes to make the difficult trivial.

Would be a plus:

  • Experience with Scala.
  • Experience with AWS.

Job Responsibilities

  • Obtains tasks from the project lead or Team Lead (TL), prepares functional and design specifications, approves them with all stakeholders.
  • Ensures that assigned area/areas are delivered within set deadlines and required quality objectives.
  • Provides estimations, agrees task duration with the manager and contributes to project plan of assigned area.
  • Analyzes scope of alternative solutions and makes decision about area implementation based on his/her experience and technical expertise.
  • Leads functional and architectural design of assigned areas. Makes sure design decisions on the project meet architectural and design requirements.
  • Addresses area-level risks, provides and implements mitigation plan.
  • Reports about area readiness/quality, and raises red flags in crisis situations which are beyond his/her AOR.
  • Responsible for resolving crisis situations within his/her AOR.
  • Initiates and conducts code reviews, creates code standards, conventions and guidelines.
  • Suggests technical and functional improvements to add value to the product;
  • Constantly improves his/her professional level.
  • Collaborates with other teams.
  • If required, make yourselves available for the visits to the client location.

Expertise level

Work arrangement

Similar Jobs in Romania

Similar Jobs in Cluj

Similar Jobs in Cluj-Napoca