Job Details
- Job Title: Senior Data Engineer
- Location: 100% Remote
- Type: Fulltime
Job Description
Our client is seeking talented and intellectually curious data engineers with a passion for the “R” in R&D. You will be part of the Data, Analytics & Technology team reporting to the Data Engineering Lead.
Responsibilities include
- Research and evaluate data sources to solve specific business problems.
- Collect and prepare data to support numerous business initiatives, including Data Science projects.
- Design and build robust, resilient, easily maintainable and reusable data pipelines.
- Contribute to the design and architecture of innovative solutions to difficult and/or novel problems.
- Closely collaborate with data engineers, software engineers, infrastructure specialists, data scientists, actuaries, underwriters, and other business stakeholders to identify, build, test, deploy, monitor, and maintain data assets, tools, and solutions to support data-driven decision-making.
Qualifications / Skills
5+ years of industry experience collecting data and building data pipelines.
Degree in Computer Science or related field.
Expert knowledge of databases and SQL.
Mastery of Python.
Experience building data pipelines from end to end:
- Understanding business use cases and requirements for different internal teams.
- Prototyping initial collection and leveraging existing tools and/or creating new tools.
- Building and deploying enterprise-grade data pipelines.
- Maintenance of such pipelines with a focus on performance and data quality.
Experience working with structured, semi-structured, and unstructured data.
Experience with Azure Dev Ops or other cloud provider’s technology stack.
Experience with code versioning and repository software.
Experience being an active member of highly functional Agile teams.
Ability to think critically and creatively in a dynamic environment, while picking up new tools and domain knowledge along the way.
A positive attitude and a growth mindset.
Excellent programming skills coupled with an understanding of software design patterns and good engineering practices.
Bonus Qualifications
- Experience with Spark Python webapp development skills (Streamlit/Flask/Django/Dash).
- Experience using property, geospatial, and image data.
- Experience solving financial and risk domain problems.