Desired Skills and Experience
- 3+ years of professional experience as a Data Engineer
- Experience using Python – Develop and maintain ETL pipelines to populate graph databases.
- Experience using Airflow – Transition existing ETL pipelines to Apache Airflow for improved orchestration and management.
Plusses
- Work with GraphDB technologies such as RDF, Owl, Neo4j, or similar.
- Knowledge of search technologies such as ElasticSearch, Apache Solr, or OpenSearch.
Day-to-Day
One of our largest clients in the is looking for a few Software Engineers to join their dynamic team. The day-to-day responsibilities involve participating in regular stand-up and refinement meetings with the collaborative team, which currently consists of 7 members.
The focus is on building and maintaining pipelines to populate graph data for an enterprise company managing data from numerous systems. Tasks include receiving work assignments for the sprint, developing pipelines to extract and manage data from various systems, such as tracking drug interactions and journal entries.
The team collaborates closely to update, collect, and integrate data from different sources into the graph database, ensuring functionality and meeting business requirements. Additionally, team members contribute to delivering features, refactoring code, and supporting peers through pair programming and code reviews. Collaboration with data scientists and medical experts helps streamline product development efforts, while troubleshooting technical issues and documentation writing enhance service quality.