We use an AI-powered matching process to ensure your application is reviewed quickly, objectively, and fairly against the role's core requirements. Our system identifies the top-fitting candidates, and this shortlist is then shared directly with the hiring company. The final decision and next steps (interviews, assessments) are managed by their internal team. We appreciate your interest and wish you the best! Data Privacy Notice: By submitting your application, you acknowledge that Jobgether will process your personal data to evaluate your candidacy and share relevant information with the hiring employer. This processing is based on legitimate interest and pre-contractual measures under applicable data protection laws (including GDPR). You may exercise your rights (access, rectification, erasure, objection) at any time. #LI-CL1 We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.
Senior AI Product Engineer
Location
United States
Posted
10 days ago
Salary
Not specified
No structured requirement data.
Job Description
Role Description
This role offers an exciting opportunity to build and scale high-performance backend systems for AI and LLM-powered applications. You will work on distributed services, APIs, and analytics platforms that process billions of data points, enabling engineers to ship reliable and impactful AI solutions. This position blends deep technical expertise with creativity, allowing you to prototype, optimize, and implement cutting-edge algorithms in a collaborative, remote-first environment. You will directly influence product innovation, work alongside customers and cross-functional teams, and help shape the future of AI observability and evaluation. The ideal candidate thrives in high-growth, technically challenging environments and is passionate about AI, backend engineering, and building systems that scale.
- Design, implement, and maintain scalable, high-performance backend services using Go, Python, Java, and TypeScript.
- Build APIs and infrastructure to support Machine Learning and LLM workflows, ensuring reliability and low-latency performance.
- Develop and maintain analytics and monitoring systems that process high-volume data streams.
- Prototype and optimize distributed services, including OLAP databases, message queues, and dimensionality reduction algorithms.
- Collaborate closely with product, design, and customer engineering teams to translate needs into backend solutions.
- Contribute to open-source frameworks and internal tools that advance platform capabilities.
- Support the development of in-house AI agents and tools that enhance ML and LLM observability.
Qualifications
- 5+ years of experience building high-performance backend systems.
- Strong programming skills in Go, Python, Java, and/or TypeScript/Node.
- Proven experience designing and operating complex SaaS platforms or distributed systems.
- Familiarity with cloud platforms and container orchestration, such as AWS, GCP, Azure, and Kubernetes.
- Enthusiasm for AI and LLM technologies, with a drive to stay current on emerging trends.
- Experience collaborating with cross-functional teams to deliver technically complex solutions.
- Strong problem-solving skills and ability to work independently in a remote-first environment.
Requirements
- Experience with distributed stream processing frameworks (Kafka, Gazette, etc.).
- Familiarity with OLAP systems or system observability tools like Prometheus.
- Knowledge of ML or data science workflows.
- Hands-on experience working with large language models or developing AI products.
Benefits
- Competitive salary range: $125,000–$225,000, plus equity.
- Comprehensive healthcare coverage (medical, dental, vision) and 401(k) plan.
- Unlimited paid time off and generous parental leave.
- Support for mental health and wellness initiatives.
- Remote-first work environment with optional NYC and SF offices.
- Monthly WFH stipend for co-working or home office needs.
- Opportunities to collaborate with leading AI engineers, researchers, and ethicists.
Job Requirements
- 5+ years of experience building high-performance backend systems.
- Strong programming skills in Go, Python, Java, and/or TypeScript/Node.
- Proven experience designing and operating complex SaaS platforms or distributed systems.
- Familiarity with cloud platforms and container orchestration, such as AWS, GCP, Azure, and Kubernetes.
- Enthusiasm for AI and LLM technologies, with a drive to stay current on emerging trends.
- Experience collaborating with cross-functional teams to deliver technically complex solutions.
- Strong problem-solving skills and ability to work independently in a remote-first environment.
- Experience with distributed stream processing frameworks (Kafka, Gazette, etc.).
- Familiarity with OLAP systems or system observability tools like Prometheus.
- Knowledge of ML or data science workflows.
- Hands-on experience working with large language models or developing AI products.
Benefits
- Competitive salary range: $125,000–$225,000, plus equity.
- Comprehensive healthcare coverage (medical, dental, vision) and 401(k) plan.
- Unlimited paid time off and generous parental leave.
- Support for mental health and wellness initiatives.
- Remote-first work environment with optional NYC and SF offices.
- Monthly WFH stipend for co-working or home office needs.
- Opportunities to collaborate with leading AI engineers, researchers, and ethicists.
Related Guides
Related Job Pages
More Full-stack Engineer Jobs
Renewable Energy Technical Lead overseeing engineering teams for renewable projects
Senior Software Engineer
Magna Legal ServicesMagna LS is a litigation consulting and support company providing services from Discovery to Trial.
Magna Legal Services is seeking a talented and driven Senior Software Engineer to join our growing technology team. The ideal candidate will have strong experience building and maintaining modern web applications and services, with a passion for leveraging AI-assisted development...
Software Engineer
Renewed VisionWe provide software to help you tell stories that change the world. Makers of ProPresenter, PVP, PVS, & Scoreboard.
We’re looking for a Software Engineer with strong production experience in React and Next.js , along with experience building and shipping applications using React Native . You’ll help build and scale the web and cross-platform client surfaces of our product ecosystem — owning me...
Mid-Level Full Stack Developer
Koniag Government Services, LLCKoniag Government Services (KGS) is an Alaska Native Owned corporation supporting the values and traditions of our native communities through an agile employee and corporate culture that delivers Enterprise Solutions, Professional Services and Operational Management to Federal Government Agencies.
The Mid-level Full-Stack Developer is an integral component of a team supporting a federal client’s IT modernization effort of both Operations & Maintenance bug fix triage support and Maintenance & Development, Modernization & Enhancements to an integral IT System. This position ...