Senior Engineer – LLMOps, MLOps

Machine Learning EngineerMachine Learning EngineerFull TimeRemoteTeam 10,001+H1B SponsorCompany SiteLinkedIn

Location

Idaho + 3 moreAll locations: Idaho, Louisiana, Nebraska, Tennessee

Posted

6 days ago

Salary

Not specified

Bachelor Degree6 yrs expEnglishAWSAzurePy SparkPythonSQL

Job Description

• Build and maintain automated CI/CD and CT (Continuous Training) pipelines across AWS and Azure • Design and execute the infrastructure for Retrieval-Augmented Generation (RAG) • Build engineering 'pipes' to securely ingest and move data from legacy systems • Implement systemized frameworks for LLM evaluation and traditional ML validation • Deploy real-time monitoring for model drift, hallucination detection, latency, and token consumption • Manage all AI resources using Infrastructure as Code (IaC) • Partner with teams using platforms like Palantir, Databricks, or Snowflake • Work directly with central IT and Security • Optimize model serving endpoints for high-throughput and low-latency • Establish rigorous version control for prompts and model weights • Automate feature stores and feature engineering pipelines • Implement automated scanning and guardrails to prevent prompt injection and data leakage

Job Requirements

  • Bachelor’s degree in Computer Science or a related field required
  • 6+ years of engineering experience, with a minimum of 3 years strictly focused on MLOps or LLMOps in a production environment
  • Deep, hands-on proficiency in both AWS and Azure ecosystems
  • Expert in Python, SQL, and PySpark
  • Professional experience with frameworks like LangSmith, Arize Phoenix, or WhyLabs
  • Understanding of statistical validation and model evaluation metrics
  • Ability to move at the speed of a startup while collaborating in a large-scale enterprise IT landscape

Benefits

  • caring culture
  • work-life balance
  • diverse, equitable, and inclusive workplace
  • opportunity to grow your career

Related Job Pages

More Machine Learning Engineer Jobs

Machine Learning Engineer6 days ago
Full TimeRemoteTeam 10,001+Since 1978H1B No Sponsor

The Senior Machine Learning Engineer will collaborate with product teams to design, develop, and deploy secure, reliable, and scalable machine learning solutions, ensuring all quality and change control standards are met. Responsibilities include writing custom code for automation and destructive testing, creating monitoring dashboards, and providing application support for production software.

United States

Spark Engineer

Bright Vision Technologies

"Retrieve the best out of you" in each process what you do.

Machine Learning Engineer6 days ago
Full TimeRemoteTeam 51-200Since 2020H1B Sponsor

The Spark Engineer will join a dynamic team to build scalable, high-performance analytics platforms using cutting-edge distributed data processing technologies. This role involves contributing to the mission of transforming business processes through technology leveraging various big data tools and environments.

United States
Machine Learning Engineer6 days ago
Full TimeRemoteTeam 11-50H1B Sponsor

The instructor will teach live, virtual didactic lessons using Company Learning Management System (LMS), delivering curriculum content and providing timely feedback to students. This role requires acting as a subject matter expert in practical nursing education while fostering a positive and supportive learning environment.

United States

Senior Principal Engineer, Borrow

SoFi

SoFi helps you save, spend, earn, borrow, invest, and protect your money–all in one app. NMLS 1121636

Machine Learning Engineer6 days ago
Full TimeRemoteTeam 1,001-5,000Since 2011H1B No Sponsor

The Senior Principal Engineer will design and maintain cloud infrastructure, mentor teams, and drive technical innovations for SoFi's developer platform.

AnsibleAWSAzureDockerGCPKubernetesTerraform
Washington