Knowledge is the best medicine.

AI/LLM Engineer

LLM EngineerMachine Learning EngineerFull TimeRemoteTeam 51-200H1B No SponsorCompany Site LinkedIn

Location

United States

Posted

29 days ago

Salary

$159.3K - $202.4K / year

Bachelor Degree3 yrs expEnglishDjangoPython

Job Description

• Develop performant, scalable, and high quality APIs and backend processes for Ostro's SaaS platform, with a strong emphasis on LLM integration. • Collaborate with cross-functional teams to implement new features and refine existing ones, particularly those involving AI/LLM capabilities. • Provide feedback on roadmap and features for your team, contributing to the strategic direction of Ostro’s AI/LLM initiatives. • Ensure code quality and compliance through thorough reviews, unit testing, and adherence to best practices for LLM-powered applications and Ostro engineering. • Optimize application performance and scalability to meet user demands, especially for LLM inference and data processing. • Stay informed about emerging AI/LLM technologies, prompt engineering techniques, and industry trends. • Troubleshoot and resolve production issues, ensuring performance, reliability, and scalability of LLM-driven features.

Job Requirements

Experience shipping LLM pipelines including preprocessing, prompt optimization, output validation, and fallback mechanisms
Experience with production use of LLM APIs (e.g., OpenAI, Gemini)
Experience building systems to measure model performance, detect drift, and ensure output quality in production environments.
Proficiency in prompt engineering and/or have developed systematic approaches to prompt design
Proficiency with Python and Django (or similar frameworks)
Strong collaboration and communication skills in cross-functional environments
Bachelor’s degree in computer science or related field, or equivalent work experience
3+ years of experience as a Software Engineer

Benefits

Impacting the future of healthcare - your innovations could very likely become the new norm for millions of people.
Working alongside the founders of the company. If you have any entrepreneurial desire to start your own company in the future, you will see first-hand what it takes.
100% fully remote but with frequent opportunities to collaborate in-person.
Technology & office setup reimbursement.
Freedom and responsibility to structure your work as you desire. We measure output and results and believe freedom allows for maximum ability.
Unlimited PTO, plus two extended company-wide closures per year!
Family leave: up to 10 weeks of 100% paid salary.
Open communication - we believe in being transparent and radically honest with no retaliation.
Competitive salary and equity.
Medical/dental/vision benefits and more.