Principal Software Engineer – Dynamo
Full-stack EngineerSoftware EngineerFull TimeRemoteTeam 10,001+Since 1993H1B SponsorCompany SiteLinkedIn
Location
California
Posted
72 days ago
Salary
$272K - $425.5K / year
Bachelor Degree15 yrs expEnglishC++CloudDistributed SystemsDockerKubernetesNode.jsPythonRustGo
Job Description
• Collaborate on the design and development of the Dynamo Kubernetes stack
• Introduce new features to the Dynamo Python SDK and Dynamo Rust Runtime Core Library
• Design, implement, and optimize distributed inference components in Rust and Python
• Contribute to the development of disaggregated serving for Dynamo-supported inference engines (vLLM, SGLang, TRT-LLM, llama.cpp, mistral.rs)
• Improve intelligent routing and KV-cache management subsystems
• Contribute to open-source repositories, participate in code reviews, and assist with issue triage on GitHub
• Work closely with the community to address issues, capture feedback, and evolve the framework’s APIs and architecture
• Write clear documentation and contribute to user and developer guides.
Job Requirements
- BS/MS or higher in computer engineering, computer science or related engineering (or equivalent experience)
- 15+ years of proven experience in related field
- Strong proficiency in systems programming (Rust and/or C++)
- Experience in Python for workflow and API development
- Experience with Go for Kubernetes controllers and operators development
- Deep understanding of distributed systems, parallel computing, and GPU architectures
- Experience with cloud-native deployment and container orchestration (Kubernetes, Docker)
- Experience with large-scale inference serving, LLMs, or similar high-performance AI workloads
- Background with memory management, data transfer optimization, and multi-node orchestration
- Familiarity with open-source development workflows (GitHub, continuous integration and continuous deployment)
- Excellent problem-solving and communication skills.
Benefits
- Highly competitive salaries
- Comprehensive benefits package
- Equity
- Health insurance
- Paid time off
- Professional development opportunities
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
Full-stack Engineer72 days ago
Full TimeRemoteTeam 11-50Since 2008H1B No Sponsor
Senior Full Stack Developer designing complex web applications for E-Commerce agency
DockerElasticSearchERPGraphQLJavaScriptMicroservicesPHPPythonRedisSymfony
United States
Fullstack Software Engineer, NodeJs / NextJs
InfluurAccess your audience through our unrivaled influencer community – Forbes 30 under 30
Full-stack Engineer72 days ago
Full TimeRemoteTeam 51-200Since 2020H1B Sponsor
Fullstack Software Engineer developing AI solutions for influencer marketing
AWSCloudDockerGoogle Cloud PlatformJavaScriptKubernetesNext.jsNode.jsSQL
California
Senior Software Engineer – Omnichat Platform, RocketChat Focus
AmeriSave Mortgage CorporationLow mortgage rates can mean big home buying dreams Mortgage lenders |NMLS ID#1168 | 866.514.7283
Full-stack Engineer72 days ago
Full TimeRemoteTeam 5,001-10,000Since 2002H1B Sponsor
Senior Software Engineer owning the Omnichat platform at AmeriSave Mortgage.
DockerJavaScriptKubernetesMicroservicesMongoDBMS SQL ServerNode.jsSQLTypeScript
Full-stack Engineer72 days ago
Full TimeRemoteTeam 1,001-5,000Since 1956H1B Sponsor
BMS Engineering Leader managing Data Center Facilities Engineering team at Olsson
Arizona + 26 moreAll locations: Arizona, Florida, Idaho, Illinois, Iowa, Kansas, Kentucky, Louisiana, Montana, Nebraska, Nevada, New Mexico, North Carolina, Ohio, Oklahoma, Michigan, Minnesota, Mississippi, Missouri, South Carolina, Tennessee, Texas, Utah, Virginia, West Virginia, Wisconsin, Wyoming