Job Description
We are seeking a knowledgeable Senior Python/ML Operations Engineer with advanced Python and Flask, Large Language Models, Open API engineering, Containerization and Swaggerexpertise for a multi-year engagement to work with a foremost Healthcare IT Solutions Group in their Innovations Project Team.
Requirements
-
Prerequisites
Advanced Python programming for back-end development for Machine Learning Operations
Expertise with OpenAPI specs
Conversant with LLMs, specifically Llama 2 or Mistral -
Tasks
Required to productionize Large Language Model (LLM) based solutions
Capable of taking an open-source Large Language Model (LLM) and fine tuning it to reflect custom data and retrieve data from a Vector database
Will be required to design a RESTful API that interfaces with a Large Language Model (LLM) and can be used for user consumption
Write Helm charts and the web front end
Must be skilled in modularizing machine learning code
Will transform Data Scientists' models into scalable, maintainable systems
Integrate the APIs with MongoDB (Reddis, Vector, databases, embedding models)
Should have expertise in deploying and managing containerized applications using Kubernetes
Ability to take an open-source hugging face model and productionalize it so that user can use it on custom data
Plan the builds with Swagger CodeGen, Editor and Inspector
Experience with Jupyter notebooks, Flask, FastAPI, and on premises Docker and Kubernetes
Angular and Node are also utilized in this environment
Document plan and steps for development