Job Description
We are seeking a talented and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will be proficient in utilizing tools such as Pyspark, Azure Databricks, Azure Data Factory, Python, and Structured Streaming to design, develop, and implement data solutions. This role will involve resolving technical challenges, collaborating with cross-functional teams, and contributing to the success of our projects.
Key Responsibilities
- Design, develop, and implement data solutions using Pyspark, Azure Databricks, and related technologies.
- Create design documents, perform program coding, and conduct testing to ensure the reliability and efficiency of data pipelines.
- Resolve technical issues through debugging, research, and investigation.
- Collaborate with team members to deliver business-critical features and support project goals.
- Provide expertise in data lake architecture, data warehouse concepts, and SQL queries.
- Communicate effectively with stakeholders to understand requirements and translate them into technical solutions.
Experience/Skills Required
- Bachelor's degree in Computer Science, Information Technology, or related field and 5+ years of experience in computer programming, software development, or related roles.
- 3+ years of solid experience in Java, with an additional 3+ years of experience in design, implementation, and support of Data Lake, Python, and Azure Databricks.
- Hands-on experience with Unix, Teradata, and other relational databases. Experience with Pyspark is a plus.
- Strong communication and problem-solving skills.
Additional Information
Top 3 Skills Needed/Required:
- React
- Azure cloud
- HTML/CSS, Node.js, npm, Redux
Experience/Qualifications that Stand Out: At least 3+ years of experience in the relevant area.
Day-to-Day Responsibilities: Focus on feature development, maintenance, and support activities.
Project: The candidate will be working on "Sam’s Promotions," contributing to business-critical deliverables.
Team Makeup: The candidate will be part of a scrum team with five or more members.
Additional Job Details
Work Arrangement: This position requires onsite presence two days per week from 8 am to 5 pm CST. Remote work is not an option.
Join our team and embark on a rewarding journey where your expertise will make a significant impact on our projects and the success of our organization. Apply now to become part of our innovative team!