Data Engineer

Job Details

Job Title: Data Engineer

Location: Remote 100%

Duration: 12+ Months

Skills Needed

• Mandatory : Python with Object oriented concepts, Spark, Problem-Solving ability, Effective communication
• Good to have : AWS

Detailed Job Description

We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python. This position requires a deep understanding of data transformation and the ability to create standalone scripts based on given business logic.

Responsibilities

• Design, develop and implement new features to our existing framework using PySpark and Python.
• Write efficient and effective standalone scripts in PySpark with transformations as per the defined business logic.
• Use your expertise in Python and Object-oriented concepts to solve complex problems and implement robust solutions.
• Work closely with the team to understand the requirements and develop solutions that align with the company's objectives.
• Test and debug code to ensure it produces the desired results.
• Document all programming tasks and procedures for future reference and troubleshooting.

Qualifications

• Proficient in Python, PySpark, and Object-oriented programming concepts.
• Proven experience as a Senior Data Engineer or similar role.
• Strong problem-solving techniques with an ability to troubleshoot complex software issues.
• Experience with AWS is preferred, but not mandatory.
• Excellent communication skills, both written and verbal.
• Self-motivated and able to work independently with minimal supervision.