Skip to main content

Data Engineer

Data Engineer
Compunnel Inc.
remote
1 month 1 week ago

Job Details

Job Title: Data Engineer

Location: Remote 100%

Duration: 12+ Months

Skills Needed

  • Mandatory : Python with Object oriented concepts, Spark, Problem-Solving ability, Effective communication
  • Good to have : AWS

Detailed Job Description

We are currently seeking a Senior Data Engineer with hands-on coding experience and a strong background in Python, PySpark, and Object-oriented programming. The ideal candidate will be responsible for designing, developing, and implementing new features to our existing framework using PySpark and Python. This position requires a deep understanding of data transformation and the ability to create standalone scripts based on given business logic.

Responsibilities

  • Design, develop and implement new features to our existing framework using PySpark and Python.
  • Write efficient and effective standalone scripts in PySpark with transformations as per the defined business logic.
  • Use your expertise in Python and Object-oriented concepts to solve complex problems and implement robust solutions.
  • Work closely with the team to understand the requirements and develop solutions that align with the company's objectives.
  • Test and debug code to ensure it produces the desired results.
  • Document all programming tasks and procedures for future reference and troubleshooting.

Qualifications

  • Proficient in Python, PySpark, and Object-oriented programming concepts.
  • Proven experience as a Senior Data Engineer or similar role.
  • Strong problem-solving techniques with an ability to troubleshoot complex software issues.
  • Experience with AWS is preferred, but not mandatory.
  • Excellent communication skills, both written and verbal.
  • Self-motivated and able to work independently with minimal supervision.

Expertise level

Work arrangement

Key skills

AWS

Similar Jobs in United States