Principal Engineer

AI EngineerMachine Learning EngineerFull TimeRemote

Location

United States

Posted

3 days ago

Salary

Not specified

No structured requirement data.

Job Description

We are looking for a Principal Engineer who will sit at the technical center of our AI platform—owning architecture, standards, and production excellence across the stack. This is not a pure research role, nor a model R&D position.

You will lead the productionization of GenAI systems—owning evaluation pipelines, tracing and observability, inference orchestration, safety guardrails, dataset/prompt workflows, and developer-facing tooling. You will translate ambiguous product problems into reliable, scalable platform capabilities that customers trust with production workloads.


You will operate as a force multiplier—setting architectural standards, mentoring senior engineers, influencing roadmap trade-offs, and partnering directly with product and executive leadership to shape technical direction.

Required Experience
  • 10+ years of software engineering experience with recent hands-on coding

  • Experience operating at Principal / Distinguished / Staff / Lead Engineer level (or equivalent while still coding)

  • Proven ownership of production GenAI systems (RAG, eval frameworks, inference services, safety/guardrails, tracing/observability)

  • Deep expertise in Python

  • Strong practical capability in TypeScript, React, and Node.js

  • Strong cloud and platform experience (AWS/GCP/Azure, Kubernetes, CI/CD, distributed systems)

  • Experience driving multi-team architecture decisions

  • Ability to communicate trade-offs clearly to senior leadership

Strong Plus
  • RAG evaluation frameworks (ragas, custom eval harnesses)

  • Vector databases (Pinecone, Weaviate, Milvus, Qdrant)

  • OpenTelemetry instrumentation

  • Performance optimization of inference systems

  • Exposure to blockchain/tamper-evidence concepts

  • Own technical vision and architecture across GenAI platform capabilities

  • Lead end-to-end productionization of AI features (not prototypes)

  • Define and operate readiness criteria for AI releases (eval gates, rollout strategy, rollback mechanisms, SLOs)

  • Design and own core platform capabilities:

    • Evaluation pipelines

    • Tracing and observability systems

    • Prompt/version/dataset workflows

    • Guardrails and safety systems

    • Inference orchestration layers

  • Establish and track metrics for latency (p95/p99), cost efficiency, quality, and safety

  • Write clear architectural proposals that influence multi-team decisions

  • Partner with Product to translate ambiguous user pain into staged technical delivery

  • Raise the engineering bar through reviews, documentation, mentoring, and principled system design

  • Contribute hands-on across Python services, Node/TypeScript APIs, and React UI when necessary

  • Join at the ground floor of a GenAI infrastructure company defining a new category

  • Shape the technical foundation before the architecture calcifies

  • Work directly with senior product and engineering leadership

  • Build production systems that AI teams depend on daily

  • Fully remote

  • ESOP equity

  • Flexible hours

  • Generous PTO

  • Global offsites

  • Education support

  • Clear advancement path

Related Job Pages

More AI Engineer Jobs

AI Engineer3 days ago
Full TimeRemote

This role involves owning the architecture, productionization, and operational excellence of machine learning and LLM infrastructure, focusing on defining how GenAI systems are evaluated, deployed, monitored, and governed at scale. The engineer will shape standards across model integration, evaluation frameworks, inference systems, and AI/ML workflow automation while operating at the intersection of AI engineering, distributed systems, and platform architecture.

United States
AI Engineer3 days ago
Full TimeRemoteTeam 51-200

The role involves architecting the agent logic, tool-calling structures, and evaluation loops that power the core creative engine, focusing on designing and refining prompts, workflows, and AI agents for high-quality creative outputs at scale. Responsibilities include collaborating with delivery teams to translate client goals into prompt-based solutions and building reusable prompt frameworks.

United States

AI Red-Teamer - Adversarial AI Testing English

Weekday (YC W21)

We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent

AI Engineer3 days ago
Part TimeRemoteTeam 11-50Since 2021H1B No Sponsor

This role is for one of our clientsCompensation: $50-$111 per hourWe are seeking AI Red-Teamers to help test and strengthen modern AI systems through adversarial evaluation. In this role, you will challenge AI models with carefully designed inputs to u...

United States
Full TimeRemoteTeam 51-200

We are seeking an AI-Enabled Senior Full-Stack Engineer to help design, build, and deliver modern software applications across backend systems, frontend applications, and cloud infrastructure. This is a hands-on consulting role where you will collaborate closely with Product Mana...

United States