Senior Big Data Engineer
Capgemini
Short Description
- Performs research, design, implementation and support tasks as a member of Capgemini team. Works in accordance with project guidelines, quality standards and code conventions.
- Responsible for area/areas within the team area of responsibility (AOR). One of the current team AOR is implement high-performance graph storage solution, integrate listeners into systems like Hadoop, Spark, and internal tools to produce graph nodes and vertices and help build visualizations and traversals of the graphs.
- Investigate, create, and implement the solutions for existing technical challenges, including building/enhancing the frameworks and tools used by other development teams
Qualifications
Must have:
- University degree in Computer Related Sciences or similar
- 5+ years of solid code profiling experience in Python
- Big Data tools: Hive, Presto, Spark (pySpark, SparkSQL), Apache Airflow, Apache Iceberg
- Data file formats: Parquet
- Docker, K8s, Git
- Proficiency in both SQL databases and NoSQL databases
- Knowledge of data warehousing concepts and tools
- Familiarity with big data processing frameworks like Apache Spark
- Proficiency in distributed computing and parallel processing
- Ability to organize and document solutions.
- A passion for streamlining systems and processes to make the difficult trivial.
Would be a plus:
- Experience with Scala.
- Experience with AWS.
Job Responsibilities
- Obtains tasks from the project lead or Team Lead (TL), prepares functional and design specifications, approves them with all stakeholders.
- Ensures that assigned area/areas are delivered within set deadlines and required quality objectives.
- Provides estimations, agrees task duration with the manager and contributes to project plan of assigned area.
- Analyzes scope of alternative solutions and makes decision about area implementation based on his/her experience and technical expertise.
- Leads functional and architectural design of assigned areas. Makes sure design decisions on the project meet architectural and design requirements.
- Addresses area-level risks, provides and implements mitigation plan.
- Reports about area readiness/quality, and raises red flags in crisis situations which are beyond his/her AOR.
- Responsible for resolving crisis situations within his/her AOR.
- Initiates and conducts code reviews, creates code standards, conventions and guidelines.
- Suggests technical and functional improvements to add value to the product;
- Constantly improves his/her professional level.
- Collaborates with other teams.
- If required, make yourselves available for the visits to the client location.
Expertise level
Work arrangement
Similar Jobs in Romania
Full-Stack Python Developer
Scalable Path
remote
2 weeks ago
Python Developer
Luxoft
remote
2 weeks ago
Senior Python Engineer
Datura AI
remote
2 weeks ago
Senior Data Engineer
accesa.eu
remote
2 weeks ago
2 weeks ago
Similar Jobs in Cluj
7 months 3 weeks ago
DevSecOps Engineer
Modus Create
remote
9 months 2 weeks ago
Python Web Developer for ML Initiatives
AscentCore
9 months 2 weeks ago
Senior Python Developer
Luxoft
10 months ago
remote
10 months ago
Similar Jobs in Cluj-Napoca
7 months 3 weeks ago
DevSecOps Engineer
Modus Create
remote
9 months 2 weeks ago
Python Web Developer for ML Initiatives
AscentCore
9 months 2 weeks ago
Senior Python Developer
Luxoft
10 months ago
remote
10 months ago