Principal Software Engineer – Akamai Inference Cloud

Full-stack EngineerSoftware EngineerFull TimeRemoteTeam 5,001-10,000H1B SponsorCompany SiteLinkedIn

Location

Massachusetts

Posted

114 days ago

Salary

$148.2K - $307.8K / year

Bachelor Degree12 yrs expEnglishCloudDistributed SystemsKubernetes

Job Description

• serve as a technical leader and architect for our globally distributed AI inference platform • drive critical technical decisions, establish architectural patterns • guide the team in building a platform that delivers OpenAI-compatible endpoints while orchestrating inference workloads across regions at massive scale • provide thought leadership, drive architectural decisions, and mentor engineers while delivering hands-on technical contributions • architect and design the core infrastructure of Akamai Inference Cloud, ensuring it is performant, compliant, economical, and explainable • make critical technical decisions on frameworks, tools, and approaches for AI workload deployment and global traffic orchestration • collaborate with cross-functional teams to define technical requirements and elevate team capabilities

Job Requirements

  • 12+ years of relevant experience and a Bachelor's degree or its equivalent
  • deep expertise in AI inference optimization, model serving, and LLM deployment at scale
  • expert-level proficiency with cloud-native technologies, Kubernetes, distributed systems, and architecting services at global scale with strict SLOs
  • solid opinions and proven experience building AI platforms developers love, including API design and cost optimization for compute-intensive workloads
  • experience with building platforms for AI application developers (RAG, agents, fine-tuning workflow)
  • working knowledge of AI safety and practices, MLOps practices and AI model lifecycle management

Benefits

  • healthcare
  • 401K savings plan
  • company holidays
  • vacation (in the form of PTO)
  • sick time
  • family friendly benefits including parental leave
  • employee assistance program including a focus on mental and financial wellness

Related Job Pages

More Full-stack Engineer Jobs

Full-stack Engineer114 days ago
Full TimeRemoteTeam 51-200H1B Sponsor

Software Engineer developing distributed systems for hyperscale data solutions company.

Java
United States
$125K - $160K / year

Software Engineer – International Integrations

HavocAI

Autonomous Solutions for Maritime Operations

Full-stack Engineer114 days ago
Full TimeRemoteTeam 11-50Since 2024H1B No Sponsor

Software Engineer leading international software development for autonomy systems.

Linux
United States
$140K - $180K / year

Senior Software Engineer

Lumin Digital

Lumin Digital is a fintech company specializing in cloud native digital banking solutions.

Full-stack Engineer114 days ago
Full TimeRemoteTeam 51-200H1B No Sponsor

Senior Software Engineer designing and developing applications at Lumin Digital

AWSCloudDockerJavaSQLTypeScript
United States
$140K - $190K / year
Full-stack Engineer114 days ago
Full TimeRemoteTeam 11-50H1B No Sponsor

Senior Software Engineer developing full stack applications

AngularAWSAzureCloudDistributed SystemsDjangoDockerDynamoDBFlaskGoogle Cloud PlatformJavaJavaScriptKubernetesMongoDBMySQLNode.jsNoSQLPostgresPythonReactSQLTerraformTypeScriptVue.js
United States