Netflix

Where you come to do the best work of your life. Follow @WeAreNetflix on Twitter, IG, Facebook, & Youtube for more

Senior Engineering Manager, Model Inference – Machine Learning Platform

Engineering ManagerEngineering ManagerFull TimeRemoteTeam 10,001+Since 1997H1B SponsorCompany SiteLinkedIn

Location

United States

Posted

52 days ago

Salary

$676K - $1,195K / year

Postgraduate Degree10 yrs expExperience acceptedEnglishDistributed SystemsPy TorchTensorflow

Job Description

• Set the vision and strategy for all aspects of model inference and serving at Netflix, ensuring our platform supports the next generation of ML innovation, including LLMs, GenAI, and real-time personalization. • Lead and develop a cohort of engineering managers and technical leads responsible for core functions, including model routing, inference systems, experimentation, serving frameworks, and the performance and scalability of model serving at Netflix. • Drive cross-team and cross-functional alignment, collaborating with ML researchers, product engineering, infrastructure, and platform partners to maximize business and member impact. • Champion operational excellence and continuous improvement, ensuring reliability, scalability, and cost-effectiveness across all model serving systems. • Define and communicate the pillar’s multi-year vision, technical strategy, and roadmap. • Anticipate future platform and business needs, especially as ML architectures and use cases evolve. • Drive the transition from legacy, domain-based serving to a unified, modular, and domain-agnostic serving platform. • Manage and mentor engineering managers and technical leads; build a strong leadership bench. • Foster a culture of high performance, candor, innovation, and inclusion, aligned with Netflix’s values. • Attract, hire, and retain outstanding talent across the pillar. • Set and uphold technical standards for reliability, scalability, and performance across all teams. • Oversee development of foundational serving infrastructure: real-time/batch inference, frameworks, experimentation, control plane, and tooling. • Ensure robust support for diverse model types (deep learning, LLMs, bandits, etc.), hardware targets (CPU/GPU), and SLAs. • Own operational health and reliability at scale, including observability, SLOs, and incident response. • Build and maintain strong partnerships with ML practitioners, product engineering, infrastructure, and platform teams. • Represent the Model Serving pillar to Netflix senior leadership, clearly communicating the vision, progress, and priorities. • Influence and drive alignment on platform direction, investment, and priorities.

Job Requirements

  • Proven success managing multiple managers in high-scale ML infrastructure/platform environments.
  • 10+ years of technical experience, with 5+ years in engineering management roles.
  • Deep expertise in ML model serving, distributed systems, and high-scale production environments.
  • Strategic thinking with a track record of delivering complex, cross-team initiatives.
  • Excellent communication and stakeholder management skills.
  • Experience driving organizational change and leading through ambiguity.
  • Experience with modern ML frameworks (e.g., PyTorch, TensorFlow), inference engines (e.g., Triton, vLLM), and experimentation platforms is a strong plus.
  • MS/PhD in Computer Science, Engineering, or related field, or equivalent experience preferred.

Benefits

  • Health Plans
  • Mental Health support
  • 401(k) Retirement Plan with employer match
  • Stock Option Program
  • Disability Programs
  • Health Savings and Flexible Spending Accounts
  • Family-forming benefits
  • Life and Serious Injury Benefits
  • Paid leave of absence programs
  • Full-time hourly employees accrue 35 days annually for paid time off to be used for vacation, holidays, and sick paid time off.
  • Full-time salaried employees are immediately entitled to flexible time off.

Related Categories

Related Job Pages

More Engineering Manager Jobs

Manager, Software Engineering

Bridgeway Benefit Technologies

Leader in technology solutions for the Taft-Hartley industry.

Engineering Manager52 days ago
Full TimeRemoteTeam 201-500H1B No Sponsor

Manager leading software engineering team at Bridgeway Benefit Technologies

ASP.NETAzureSQL.NET
United States

Engineering Manager

Red Ventures

We help people discover and decide.

Engineering Manager52 days ago
Full TimeRemoteTeam 1,001-5,000Since 2000H1B Sponsor

Engineering Manager leading software teams for Red Ventures' digital transformation.

AWSAzureERPJavaScriptNode.jsReactSQLTerraformTypeScript
North Carolina
$130K - $190K / year

Engineering Manager

TixTrack

Ticket Sales Optimization: TixTrack can help increase ticket sales, optimize pricing, and better manage inventory.

Engineering Manager52 days ago
Full TimeRemoteTeam 11-50Since 2009H1B No Sponsor

Engineering Manager leading a team at TixTrack for innovative ticketing solutions

California + 13 moreAll locations: California, Colorado, Connecticut, Florida, Louisiana, New Jersey, New York, North Carolina, Oregon, Minnesota, South Carolina, Texas, Virginia, Wisconsin
$150K - $170K / year

Engineering Manager, Wikidata Platform

Wikimedia Foundation

Imagine a world in which every single human being can freely share in the sum of all knowledge.

Engineering Manager53 days ago
Full TimeRemoteTeam 501-1,000Since 2003H1B Sponsor

Engineering Manager leading the Wikidata Platform team at Wikimedia Foundation

United States
$132.4K - $208.4K / year