AI-powered enterprise knowledge management
Senior Engineering Manager – Accelerated Compute Memory Systems
Location
New York
Posted
156 days ago
Salary
Not specified
Job Description
Job Requirements
- 10+ years in software engineering, 5+ years in management roles with large-scale AI/ML systems and infrastructure.
- Expert-level proficiency in Python and Golang, with 5+ years building production distributed systems.
- Experience with orchestration frameworks (Kubernetes, Ray, Dask).
- Proficiency with vector databases (Pinecone, Weaviate, Qdrant, or similar).
- Experience with message queuing systems (Kafka, Pulsar, RabbitMQ).
- In-depth knowledge and hands on experience building scalable distributed architectures and high-performance compute systems.
- Proven experience in multimodal ingestion pipelines within RAG platforms.
- Direct experience in designing, fine-tuning, and optimizing LLMs for ingestion and retrieval workloads.
- Previous success managing engineering teams delivering production-grade, HPC-scale RAG systems.
- Deep understanding of infra domains: compute, storage, networking, observability, security, disaster recovery, and cost management.
- Familiarity with HPC cluster management softwares such as Slurm.
- Familiarity with cloud platforms (AWS, Azure, GCP) and/or on-prem datacenter operations.
Benefits
- Remote first organization
- 100% Company paid Health/Dental/Vision benefits for you and your dependents
- Life Insurance, Short-term and Long-term Disability
- 401k
- Unlimited PTO
Related Guides
Related Categories
Related Job Pages
More Engineering Manager Jobs
Engineering Manager, Machine Learning, Model Evaluations, Data Curation
NetflixWhere you come to do the best work of your life. Follow @WeAreNetflix on Twitter, IG, Facebook, & Youtube for more
Engineering Manager leading AI/ML researchers and engineers at Netflix
Engineering Manager
VirtruRespect the people. Respect the data. Virtru equips you to protect your data anywhere and everywhere it's shared.
Engineering Manager leading digital privacy product development at Virtru
Engineering Manager
ActBlueActBlue is a nonprofit tech organization working to help Democratic campaigns, progressive organizations, and nonprofits build campaigns fueled by small-dollar donors. Our tools make it possible for anyone to build a grassroots campaign or movement and give donors an easy and secure way to support their favorite candidates and causes.
Engineering Manager leading Developer Experience team at ActBlue, nonprofit building fundraising technology
Engineering Manager, Database Integrations
ClickHouseClickHouse is an open-source, column-oriented OLAP database management system.
Engineering Manager leading ClickHouse ClickPipes database connectors and distributed ingestion pipelines