Pryon

AI-powered enterprise knowledge management

Senior Engineering Manager – Accelerated Compute Memory Systems

Engineering ManagerEngineering ManagerFull TimeRemoteTeam 51-200H1B No SponsorCompany SiteLinkedIn

Location

New York

Posted

156 days ago

Salary

Not specified

Bachelor Degree10 yrs expEnglishAWSAzureCloudDistributed SystemsGoogle Cloud PlatformKafkaKubernetesPulsarPythonRabbit MQRayGo

Job Description

• Build and lead a team delivering the ingestion, retrieval, and inference layers that will power mission-critical deployments for commercial and federal entities with millions of public users. • Architect and deliver horizontally scalable, fault-tolerant systems capable of handling billions of documents and burst loads of 30K+ concurrent users. • Guide implementation of multimodal ingestion pipelines (eg PDF, HTML, DOCX, JSON, XML, PPTX, TIFF). • Oversee design and optimization of LLM-driven data ingestion and retrieval workflows. • Own optimization and tuning of high-throughput, low-latency production environments via async orchestration frameworks. • Establish performance benchmarking, compliance frameworks, and automated testing for scale. • You will balance technical leadership with people leadership, guiding architecture decisions, while also scaling and mentoring a high-performing team. • Collaborate cross-functionally with Product, Executive Leadership, and Customer Success.

Job Requirements

  • 10+ years in software engineering, 5+ years in management roles with large-scale AI/ML systems and infrastructure.
  • Expert-level proficiency in Python and Golang, with 5+ years building production distributed systems.
  • Experience with orchestration frameworks (Kubernetes, Ray, Dask).
  • Proficiency with vector databases (Pinecone, Weaviate, Qdrant, or similar).
  • Experience with message queuing systems (Kafka, Pulsar, RabbitMQ).
  • In-depth knowledge and hands on experience building scalable distributed architectures and high-performance compute systems.
  • Proven experience in multimodal ingestion pipelines within RAG platforms.
  • Direct experience in designing, fine-tuning, and optimizing LLMs for ingestion and retrieval workloads.
  • Previous success managing engineering teams delivering production-grade, HPC-scale RAG systems.
  • Deep understanding of infra domains: compute, storage, networking, observability, security, disaster recovery, and cost management.
  • Familiarity with HPC cluster management softwares such as Slurm.
  • Familiarity with cloud platforms (AWS, Azure, GCP) and/or on-prem datacenter operations.

Benefits

  • Remote first organization
  • 100% Company paid Health/Dental/Vision benefits for you and your dependents
  • Life Insurance, Short-term and Long-term Disability
  • 401k
  • Unlimited PTO

Related Categories

Related Job Pages

More Engineering Manager Jobs

Engineering Manager, Machine Learning, Model Evaluations, Data Curation

Netflix

Where you come to do the best work of your life. Follow @WeAreNetflix on Twitter, IG, Facebook, & Youtube for more

Engineering Manager158 days ago
Full TimeRemoteTeam 10,001+Since 1997H1B Sponsor

Engineering Manager leading AI/ML researchers and engineers at Netflix

United States
$190K - $920K / year

Engineering Manager

Virtru

Respect the people. Respect the data. Virtru equips you to protect your data anywhere and everywhere it's shared.

Engineering Manager164 days ago
Full TimeRemoteTeam 51-200Since 2012H1B No Sponsor

Engineering Manager leading digital privacy product development at Virtru

Distributed SystemsJavaGo
District of Columbia + 1 moreAll locations: District of Columbia, Washington
$190K - $240K / year

Engineering Manager

ActBlue

ActBlue is a nonprofit tech organization working to help Democratic campaigns, progressive organizations, and nonprofits build campaigns fueled by small-dollar donors. Our tools make it possible for anyone to build a grassroots campaign or movement and give donors an easy and secure way to support their favorite candidates and causes.

Engineering Manager166 days ago
Full TimeRemoteTeam 201-500Since 2004H1B No Sponsor

Engineering Manager leading Developer Experience team at ActBlue, nonprofit building fundraising technology

Arizona + 27 moreAll locations: Arizona, California, Colorado, Connecticut, Florida, Hawaii, Illinois, New Hampshire, New Jersey, New York, North Carolina, North Dakota, Ohio, Oregon, Maryland, Massachusetts, Michigan, Minnesota, Missouri, Pennsylvania, Rhode Island, South Carolina, Texas, Utah, Vermont, Virginia, Washington, Wisconsin
$173.7K - $210.7K / year

Engineering Manager, Database Integrations

ClickHouse

ClickHouse is an open-source, column-oriented OLAP database management system.

Engineering Manager166 days ago
Full TimeRemoteTeam 51-200Since 2016H1B Sponsor

Engineering Manager leading ClickHouse ClickPipes database connectors and distributed ingestion pipelines

AWSAzureBigQueryCloudDistributed SystemsGoogle Cloud PlatformKubernetesMongoDBPostgresGo
United States