Pulley

Equity management for high growth startups. Join us on our mission: https://boards.greenhouse.io/pulley.

Staff Backend Engineer, AI

Backend EngineerSoftware EngineerFull TimeRemoteTeam 11-50H1B No SponsorCompany SiteLinkedIn

Location

United States

Posted

102 days ago

Salary

$200K - $240K / year

Bachelor Degree7 yrs expEnglishAWSCloudDistributed SystemsDockerGoogle Cloud PlatformKubernetesMicroservicesPostgresPythonRedisGo

Job Description

• Architect distributed systems that power AI agent orchestration, handling complex multi-step workflows with reliability and observability • Design and implement core backend services in Golang for high-performance, concurrent operations and Python for AI/ML integrations and data pipelines • Build robust APIs and service interfaces that abstract AI capabilities for consumption by multiple clients and internal systems • Own the technical roadmap for backend infrastructure supporting LLM integrations, vector search, and real-time data processing • Establish architectural patterns and standards for service design, data modeling, and inter-service communication • Drive system scalability and reliability, implementing caching strategies, database optimization, and async processing patterns • Build data pipelines that process equity data, embeddings, and user interactions to continuously improve AI model performance • Collaborate cross-functionally to translate business requirements into technical architecture and make pragmatic build vs. buy decisions • Mentor engineers on backend best practices, system design, and technical decision-making

Job Requirements

  • 7+ years of backend engineering experience building production systems at scale
  • Expert-level proficiency in Python for AI/ML integrations, data processing, and scripting
  • Strong Python skills with deep understanding of concurrency patterns, performance optimization, and production Go services
  • Proven experience designing and building distributed systems, including microservices architecture, event-driven systems, and async workflows
  • Deep knowledge of API design (REST) and service-to-service communication patterns
  • Demonstrated experience building backend systems that integrate LLMs and AI capabilities into production applications
  • Hands-on work with agent frameworks, LLM orchestration, and AI service reliability
  • Familiarity with RAG architectures, vector databases (Pinecone, Weaviate, Qdrant), and embeddings pipelines
  • Experience building evaluation frameworks and observability for AI systems
  • Understanding of prompt engineering and LLM API optimization (latency, costs, rate limits)
  • Track record of architecting greenfield services from concept to production with scalability and maintainability in mind
  • Experience with database design and optimization (PostgreSQL, Redis, time-series databases)
  • Strong foundation in system observability, monitoring, and debugging distributed systems in production
  • Proven ability to lead technical initiatives and establish engineering best practices
  • Experience mentoring engineers and elevating team technical capabilities
  • Experience with Kubernetes, Docker, and cloud infrastructure (AWS/GCP) is a bonus
  • Background in FinTech or regulated industries is a bonus
  • Contributions to open-source projects or technical writing is a bonus
  • Familiarity with AI-powered developer tools like Cursor or Copilot is a bonus.

Benefits

  • Competitive salary and equity
  • Medical, Dental, and Vision insurance
  • Unlimited PTO + Winter holiday break
  • Parental leave
  • Generous stipends for WFH, learning, wellness, and AI tools
  • 401(k) match (US) / Pension match (Canada)

Related Job Pages

More Backend Engineer Jobs

Chief Architect

Accommodations Plus International

Providing the best and most efficient layover experience for our clients and their team members.

Backend Engineer102 days ago
Full TimeRemoteTeam 201-500Since 1984H1B No Sponsor

Chief Architect leading enterprise-wide architecture function for global platform

AWSAzureCloudDistributed SystemsGoogle Cloud PlatformMicroservices
New York
$220K - $240K / year

D365 F&SC Technical Architect

Ludia Consulting

Creating value every day with integrity and respect for our clients and employees

Backend Engineer102 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

Microsoft Dynamics 365 F&SC Technical Architect for client solutions and technical architecture

AzureERPSQL
United States
Backend Engineer102 days ago
Full TimeRemoteTeam 11-50Since 2022H1B No Sponsor

Open this job to view full details and requirements.

AWSDistributed SystemsDockerJavaKafkaKotlinKubernetesMicroservicesMySQLPHPPostgresRabbitMQRedisSQL
California

Senior Python Engineer

Codelitt

Delivering unforgettable digital product experiences when you need it most.

Backend Engineer103 days ago
ContractRemoteTeam 11-50H1B No Sponsor

Senior Python Engineer developing tools for a wealth-management technology company

AWSCloudKafkaNoSQLPandasPythonPyTorchSQLTensorflowTerraform
United States