Required Skills & Experience
Bachelor’s degree in computer science, or related technical discipline
5+ years technical engineering experience with coding in languages including, but not limited to, Python, Java, C#, KQL (Azure Data Explorer)
Experience with infrastructure as code tools like Terraform and Bicep and with Azure DevOps concepts
Previous experience implementing, maintaining, and scaling data infrastructure, ETL pipelines, CI/CD automation, deployment patterns, and monitoring
Nice to Have Skills & Experience
Recent experience with any Azure data engineering or ML platforms like Azure Databricks, Azure Machine Learning
Experience implementing and operating ML infrastructure in previous roles
Experience with Large Language Models (LLMs), such as GPT-3/4, BERT, T5, etc., and their applications and limitations or equivalent combination of working knowledge of ML models and education
Job Description
This role will be partnered with Core Engineering and Architecture to define the platform, frameworks, and best practices to implement ML Architecture, as well as partner with Product to align business expectations and roadmaps with the AI solution design. The role will also be a key driver that enables the integration of AI Large Language Models (LLMs) with conventional programming languages and systems. We are looking for someone that can help us establish an extensible architecture and a programming model that combines natural language prompts, traditional code, and embeddings-based memory to unlock new potential and add value to applications with AI.
- Design, build, test, and document applications and services that demonstrate AI orchestration with AI engineering best practices.
- Overseas and participates in the buildout of automated ML pipelines for training, deployment, and monitoring.
- Incorporate feature store, model registry, and software engineering best practices.
- Explore and recommend technological trends such as AI/ML, data security and privacy, and more.
- Ensure the quality, reliability, security, and maintainability of the application and services.
- Participate in code reviews and contribute to the development of a clean, well-documented codebase.
- Drive and orchestrate identification of dependencies and the development of design documents for a product, application, service, or platform.
Task Breakdown
- 10% Meetings
- 80% heads down Coding
- 10% Design and security checkpoints