Data Engineer

Data Engineer Position in Houston, TX

We are seeking a skilled mid to senior level Python Data Engineer to join our clients' team in Houston, TX. The ideal candidate will have 5+ years of experience in data engineering with a strong background in Python, SQL, and Java. The role involves collaborating with Data Scientists and Business Analysts to process and analyze data for actionable insights.

Responsibilities

• Data Pipeline Development: Building and maintaining efficient data pipelines for data collection and storage.
• Data Integration: Collaborating with cross-functional teams to integrate data from various sources into systems.
• Database Management: Designing, optimizing, and maintaining databases using SQL and NoSQL technologies.
• Software Development: Writing clean and efficient code using Node.js, Python, Java, and more.
• Linux Job Scheduling: Utilizing Slurm or similar systems for resource management and job scheduling.
• Containerization: Experience with Kubernetes for container orchestration.
• Streaming Data: Working with real-time data processing and streaming technologies like MQTT and Kafka.
• Data Quality: Ensuring data accuracy and consistency through validation and cleansing processes.
• Performance Optimization: Identifying and resolving bottlenecks in data processing and storage.
• Documentation: Maintaining comprehensive documentation for data pipelines and systems.

Requirements

• Bachelor's degree in Computer Science, Information Systems, or related field.
• At least 5 years of data engineering experience.
• Proficiency in Node.js, Python, SQL, and Java.
• Experience with Linux job scheduling, particularly with Slurm.
• Familiarity with containerization technologies, especially Kubernetes.
• Knowledge of streaming data technologies such as MQTT and Kafka.
• Strong problem-solving skills and the ability to work in a collaborative environment.
• Excellent communication skills and the ability to convey technical concepts to non-technical stakeholders.
• Commitment to best practices in data engineering and data security.

Exciting Opportunity with Benefits

This is an exciting opportunity to join a startup organization and work with a Fortune 200 company. If you are a strategic thinker passionate about delivering innovative products, we would love to hear from you.

Benefits

• Profit Sharing
• 401k with match
• 100% paid medical premiums
• Career development/training opportunities