Python Data Engineer
As a Python Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines to support our data-driven business. You will also be responsible for developing and maintaining their APIs using the FASTAPI framework and SQL Alchemy ORM. Experience working with LLMs is a plus!
The ideal candidate will have 3+ years of experience in data engineering with a focus on Python, and will work closely with our Data Scientists and Business Analysts to ensure that data is properly collected, processed, and analyzed to generate insights and drive business decisions. You must have a good understanding of SQL. Experience with Postgres is a plus, although not a requirement. The candidate will be required to work on-site at our Client's office in Downtown Houston.
Responsibilities
- Design, develop and maintain RESTful APIs using Python and FASTAPI framework.
- Extensive experience building APIs and integrating them with various systems and platforms.
- Work closely with our database team to ensure seamless integration with Postgres.
- Write efficient and reusable code using best practices.
- Ensure code quality, including automated tests and code reviews.
- Collaborate with Data Scientists and Business Analysts to ensure data quality and accuracy.
- Develop and maintain data models and data schema.
- Deploy and manage applications in Azure using Docker.
- Set up monitoring and metrics using Grafana.
- Create and maintain documentation for data pipelines and processes.
- Monitor data pipelines to identify and address issues in a timely manner.
- Work with cross-functional teams to ensure data is properly integrated across systems.
Requirements
- Bachelor's degree in Computer Science, Information Systems, or a related field.
- Minimum 3 years of experience in developing APIs using Python.
- Strong experience with FASTAPI and SQLAlchemy ORM.
- Strong experience building APIs and integrating them with various systems and platforms.
- Experience with Postgres or other relational databases.
- Experience with Docker and Azure deployment is a plus.
- Familiarity with Grafana or similar monitoring tools is a plus.
- Strong understanding of software development principles, design patterns, and best practices.
- Knowledge of SQL and database design principles is a plus.
- Experience with data modeling and schema design.
- Strong problem-solving and analytical skills.
- Excellent communication and collaboration skills.