Arbiter
Unifying and automating referral workflows so that every patient reaches the right provider at the right time and cost.
Senior Backend AI Engineer
Location
New York
Posted
58 days ago
Salary
$180K - $240K / year
Bachelor Degree5 yrs expEnglishAWSAzureCloudDistributed SystemsGoogle Cloud PlatformGRPCPython
Job Description
• Design, build, and operate the backend AI systems that power Arbiter’s intelligent care orchestration platform.
• Own critical parts of our agentic infrastructure, from low-latency inference pipelines to workflow automation and service orchestration.
• Ship and maintain production-grade AI systems that automate complex clinical and administrative workflows.
• Contribute to the architectural design of Arbiter’s AI-driven platform, emphasizing modularity and scalability.
• Ensure high performance, low latency, and fault tolerance across backend services and AI inference pipelines.
• Implement and uphold best practices for CI/CD, testing, observability, and deployment of backend and AI systems.
• Partner closely with data scientists, product managers, clinical experts, and other engineers.
• Mentor engineers, contribute to internal documentation and standards, and raise the overall engineering bar.
• Take end-to-end ownership of critical systems, including participating in on-call rotations.
Job Requirements
- 5 + years of hands-on experience building and operating production backend systems, recent experience with AI-powered services and automation workflows, in high-availability environments.
- Computer Science or Engineering degree, or equivalent practical experience.
- Experience building and maintaining large-scale Python codebases with strong opinions on structure, quality, and tradeoffs.
- Proven experience designing and operating complex backend systems in production.
- Deep understanding of concurrency, scalability, reliability, and distributed systems patterns.
- Hands-on experience with async or event-driven architectures.
- Experience designing and operating high-scale APIs (REST and/or gRPC), including versioning and backward compatibility.
- Experience with cloud infrastructure (AWS, GCP, or Azure) and production deployments.
- Experience building and shipping AI-powered systems beyond prototypes or internal demos.
- Strong communication skills and ability to work effectively across functions.
Benefits
- Highly Competitive Salary & Equity Package: Designed to rival top FAANG compensation, including meaningful equity.
- Generous Paid Time Off (PTO): To ensure a healthy work-life balance.
- Comprehensive Health, Vision, and Dental Insurance: Robust coverage for you and your family.
- Life and Disability Insurance: Providing financial security.
- Simple IRA Matching: To support your long-term financial goals.
- Professional Development Budget: Support for conferences, courses, and certifications to fuel your continuous learning.
- Wellness Programs: Initiatives to support your physical and mental health.
Related Guides
Related Job Pages
More Backend Engineer Jobs
Backend Engineer58 days ago
Full TimeRemoteTeam 51-200Since 2012H1B No Sponsor
Senior Backend Developer for high-traffic retail and eCommerce platforms
AWSAzureCloudDistributed SystemsDynamoDBGoogle Cloud PlatformJavaMicroservicesMySQLNoSQLPostgresRedisSpringSpring BootSpringBootSQL
United States
Backend Engineer58 days ago
ContractRemoteTeam 1,001-5,000H1B Sponsor
Backend Developer developing and maintaining backend systems at Indium
United States
Director of Software Engineering, Java, Streaming
FICOFICO is an analytics company helping businesses make better decisions that drive higher levels of growth and success.
Backend Engineer58 days ago
Full TimeRemoteTeam 1,001-5,000Since 1956H1B No Sponsor
Director of Software Engineering leading software engineers in enhancing FICO’s streaming platform
AngularAWSAzureCassandraCloudDockerJavaJavaScriptKafkaKubernetesMySQLOraclePulsarPythonSparkSpringZookeeper
Backend Engineer58 days ago
Full TimeRemoteTeam 201-500H1B Sponsor
Senior Backend Software Engineer building e-commerce systems at Gametime.
AWSAzureCloudDistributed SystemsDynamoDBJavaKafkaMicroservicesMongoDBMySQLNoSQLPostgresPythonRabbitMQRubyRustScalaGo