Principal Engineer
Location
United States
Posted
3 days ago
Salary
Not specified
No structured requirement data.
Job Description
We are looking for a Principal Engineer who will sit at the technical center of our AI platform—owning architecture, standards, and production excellence across the stack. This is not a pure research role, nor a model R&D position.
You will lead the productionization of GenAI systems—owning evaluation pipelines, tracing and observability, inference orchestration, safety guardrails, dataset/prompt workflows, and developer-facing tooling. You will translate ambiguous product problems into reliable, scalable platform capabilities that customers trust with production workloads.
You will operate as a force multiplier—setting architectural standards, mentoring senior engineers, influencing roadmap trade-offs, and partnering directly with product and executive leadership to shape technical direction.
Required Experience10+ years of software engineering experience with recent hands-on coding
Experience operating at Principal / Distinguished / Staff / Lead Engineer level (or equivalent while still coding)
Proven ownership of production GenAI systems (RAG, eval frameworks, inference services, safety/guardrails, tracing/observability)
Deep expertise in Python
Strong practical capability in TypeScript, React, and Node.js
Strong cloud and platform experience (AWS/GCP/Azure, Kubernetes, CI/CD, distributed systems)
Experience driving multi-team architecture decisions
Ability to communicate trade-offs clearly to senior leadership
RAG evaluation frameworks (ragas, custom eval harnesses)
Vector databases (Pinecone, Weaviate, Milvus, Qdrant)
OpenTelemetry instrumentation
Performance optimization of inference systems
Exposure to blockchain/tamper-evidence concepts
Own technical vision and architecture across GenAI platform capabilities
Lead end-to-end productionization of AI features (not prototypes)
Define and operate readiness criteria for AI releases (eval gates, rollout strategy, rollback mechanisms, SLOs)
Design and own core platform capabilities:
Evaluation pipelines
Tracing and observability systems
Prompt/version/dataset workflows
Guardrails and safety systems
Inference orchestration layers
Establish and track metrics for latency (p95/p99), cost efficiency, quality, and safety
Write clear architectural proposals that influence multi-team decisions
Partner with Product to translate ambiguous user pain into staged technical delivery
Raise the engineering bar through reviews, documentation, mentoring, and principled system design
Contribute hands-on across Python services, Node/TypeScript APIs, and React UI when necessary
Join at the ground floor of a GenAI infrastructure company defining a new category
Shape the technical foundation before the architecture calcifies
Work directly with senior product and engineering leadership
Build production systems that AI teams depend on daily
Fully remote
ESOP equity
Flexible hours
Generous PTO
Global offsites
Education support
Clear advancement path
Related Guides
Related Job Pages
More AI Engineer Jobs
This role involves owning the architecture, productionization, and operational excellence of machine learning and LLM infrastructure, focusing on defining how GenAI systems are evaluated, deployed, monitored, and governed at scale. The engineer will shape standards across model integration, evaluation frameworks, inference systems, and AI/ML workflow automation while operating at the intersection of AI engineering, distributed systems, and platform architecture.
The role involves architecting the agent logic, tool-calling structures, and evaluation loops that power the core creative engine, focusing on designing and refining prompts, workflows, and AI agents for high-quality creative outputs at scale. Responsibilities include collaborating with delivery teams to translate client goals into prompt-based solutions and building reusable prompt frameworks.
AI Red-Teamer - Adversarial AI Testing English
Weekday (YC W21)We are a Y-Combinator-backed startup building your AI-powered Recruiter Agent
This role is for one of our clientsCompensation: $50-$111 per hourWe are seeking AI Red-Teamers to help test and strengthen modern AI systems through adversarial evaluation. In this role, you will challenge AI models with carefully designed inputs to u...
We are seeking an AI-Enabled Senior Full-Stack Engineer to help design, build, and deliver modern software applications across backend systems, frontend applications, and cloud infrastructure. This is a hands-on consulting role where you will collaborate closely with Product Mana...