Senior II Software Engineer Lead – Akamai Inference Cloud

Full-stack EngineerSoftware EngineerFull TimeRemoteTeam 5,001-10,000H1B SponsorCompany SiteLinkedIn

Location

Massachusetts

Posted

116 days ago

Salary

$126.1K - $261.9K / year

Bachelor Degree8 yrs expEnglishCloudDistributed SystemsDockerGRPCKubernetes

Job Description

• Leading the design and implementation of critical platform components for Akamai Inference Cloud, ensuring performance, scalability, and reliability • Driving technical decisions for your domain, selecting appropriate tools, frameworks, and approaches for AI inference workloads • Mentoring and guiding engineers on the team through code reviews, design discussions, and technical problem-solving • Implementing and optimizing containerized AI workloads with hardware-specific optimizations and integrating inference frameworks at scale • Collaborating across teams to define technical requirements, contribute to platform standards, and ensure operational excellence

Job Requirements

  • 8 years of relevant experience and a Bachelor's degree or its equivalent
  • Solid proficiency in distributed systems, cloud services, and platform engineering
  • Hands-on experience with AI inference, model serving, or LLM deployment with working knowledge of inference frameworks (TensorRT, vLLM, TorchServe, Triton)
  • Expertise in containerization and orchestration technologies including Kubernetes, Docker, and cloud-native architectures
  • Proven experience building scalable, high-performance systems with modern DevOps practices, CI/CD pipelines, and infrastructure-as-code
  • Familiarity with API design and development (REST/gRPC patterns), GPU infrastructure and hardware acceleration
  • Knowledge of observability, monitoring, and debugging distributed systems

Benefits

  • Health insurance
  • 401K savings plan
  • Company holidays
  • Vacation (in the form of PTO)
  • Sick time
  • Family friendly benefits including parental leave
  • Employee assistance program including a focus on mental and financial wellness
  • Employee Stock Purchase Plan (ESPP)

Related Job Pages

More Full-stack Engineer Jobs

Full-stack Engineer116 days ago
Full TimeRemoteTeam 51-200H1B Sponsor

Software Engineer developing distributed systems for hyperscale data solutions company.

Java
United States
$125K - $160K / year

Software Engineer – International Integrations

HavocAI

Autonomous Solutions for Maritime Operations

Full-stack Engineer116 days ago
Full TimeRemoteTeam 11-50Since 2024H1B No Sponsor

Software Engineer leading international software development for autonomy systems.

Linux
United States
$140K - $180K / year

Senior Software Engineer

Lumin Digital

Lumin Digital is a fintech company specializing in cloud native digital banking solutions.

Full-stack Engineer116 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

Senior Software Engineer designing and developing applications at Lumin Digital

AWSCloudDockerJavaSQLTypeScript
United States
$140K - $190K / year
Full-stack Engineer116 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

Senior Software Engineer developing full stack applications

AngularAWSAzureCloudDistributed SystemsDjangoDockerDynamoDBFlaskGoogle Cloud PlatformJavaJavaScriptKubernetesMongoDBMySQLNode.jsNoSQLPostgresPythonReactSQLTerraformTypeScriptVue.js
United States