Principal Software Engineer – Dynamo

Full-stack EngineerSoftware EngineerFull TimeRemoteTeam 10,001+Since 1993H1B SponsorCompany SiteLinkedIn

Location

California

Posted

72 days ago

Salary

$272K - $425.5K / year

Bachelor Degree15 yrs expEnglishC++CloudDistributed SystemsDockerKubernetesNode.jsPythonRustGo

Job Description

• Collaborate on the design and development of the Dynamo Kubernetes stack • Introduce new features to the Dynamo Python SDK and Dynamo Rust Runtime Core Library • Design, implement, and optimize distributed inference components in Rust and Python • Contribute to the development of disaggregated serving for Dynamo-supported inference engines (vLLM, SGLang, TRT-LLM, llama.cpp, mistral.rs) • Improve intelligent routing and KV-cache management subsystems • Contribute to open-source repositories, participate in code reviews, and assist with issue triage on GitHub • Work closely with the community to address issues, capture feedback, and evolve the framework’s APIs and architecture • Write clear documentation and contribute to user and developer guides.

Job Requirements

  • BS/MS or higher in computer engineering, computer science or related engineering (or equivalent experience)
  • 15+ years of proven experience in related field
  • Strong proficiency in systems programming (Rust and/or C++)
  • Experience in Python for workflow and API development
  • Experience with Go for Kubernetes controllers and operators development
  • Deep understanding of distributed systems, parallel computing, and GPU architectures
  • Experience with cloud-native deployment and container orchestration (Kubernetes, Docker)
  • Experience with large-scale inference serving, LLMs, or similar high-performance AI workloads
  • Background with memory management, data transfer optimization, and multi-node orchestration
  • Familiarity with open-source development workflows (GitHub, continuous integration and continuous deployment)
  • Excellent problem-solving and communication skills.

Benefits

  • Highly competitive salaries
  • Comprehensive benefits package
  • Equity
  • Health insurance
  • Paid time off
  • Professional development opportunities

Related Job Pages

More Full-stack Engineer Jobs

Full-stack Engineer72 days ago
Full TimeRemoteTeam 11-50Since 2008H1B No Sponsor

Senior Full Stack Developer designing complex web applications for E-Commerce agency

DockerElasticSearchERPGraphQLJavaScriptMicroservicesPHPPythonRedisSymfony
United States

Fullstack Software Engineer, NodeJs / NextJs

Influur

Access your audience through our unrivaled influencer community – Forbes 30 under 30

Full-stack Engineer72 days ago
Full TimeRemoteTeam 51-200Since 2020H1B Sponsor

Fullstack Software Engineer developing AI solutions for influencer marketing

AWSCloudDockerGoogle Cloud PlatformJavaScriptKubernetesNext.jsNode.jsSQL
California

Senior Software Engineer – Omnichat Platform, RocketChat Focus

AmeriSave Mortgage Corporation

Low mortgage rates can mean big home buying dreams Mortgage lenders |NMLS ID#1168 | 866.514.7283

Full-stack Engineer72 days ago
Full TimeRemoteTeam 5,001-10,000Since 2002H1B Sponsor

Senior Software Engineer owning the Omnichat platform at AmeriSave Mortgage.

DockerJavaScriptKubernetesMicroservicesMongoDBMS SQL ServerNode.jsSQLTypeScript
United States
$140K - $180K / year

BMS Engineering Leader – Data Center

Olsson

We engineer solutions that improve communities.

Full-stack Engineer72 days ago
Full TimeRemoteTeam 1,001-5,000Since 1956H1B Sponsor

BMS Engineering Leader managing Data Center Facilities Engineering team at Olsson

Arizona + 26 moreAll locations: Arizona, Florida, Idaho, Illinois, Iowa, Kansas, Kentucky, Louisiana, Montana, Nebraska, Nevada, New Mexico, North Carolina, Ohio, Oklahoma, Michigan, Minnesota, Mississippi, Missouri, South Carolina, Tennessee, Texas, Utah, Virginia, West Virginia, Wisconsin, Wyoming