CDW

CDW Corporation is a leading multi-brand provider of information technology solutions to business, government, education and healthcare customers in the United States, the United Kingdom and Canada. A Fortune 500 company and member of the S&P 500 Index, CDW helps its customers to navigate an increasingly complex IT market and maximize return on their technology investments. For more information about CDW, please visit www.CDW.com. Our broad array of products and services range from hardware and software to integrated IT solutions such as security, cloud, hybrid infrastructure and digital experience.

Senior AI Engineer

AI EngineerMachine Learning EngineerFull TimeRemoteTeam 10,001+Since 1984H1B SponsorCompany SiteLinkedIn

Location

Illinois

Posted

51 days ago

Salary

$124K - $174.6K / year

Bachelor Degree5 yrs expExperience acceptedEnglishReactService Now

Job Description

• Agentic Engineering & Orchestration Workflow Design: Architect complex, multi-agent workflows using Microsoft AI tech stack. • Design, Develop and Deploy agents to handle loops, interruptions, and human-in-the-loop interventions. • Tool Use & Function Calling: Build reliable "tool layers" that allow LLMs to safely interact with internal APIs, databases, and third-party SaaS platforms (e.g., Salesforce, Workday, ServiceNow etc.). • State Management: Design persistence layers to manage agent memory, conversational history, and context windows efficiently. • Advanced Data & RAG Strategy Retrieval Pipelines: Build production-grade data retrieval and integration systems. • Optimize vector indexing, document chunking, and re-ranking algorithms to ensure high-precision context retrieval. • Data Quality: Collaborate with Data Engineers to curate "Golden Datasets" for agent consumption. • LLMOps, Evaluation & Quality Automated Evaluation: Build CI/CD pipelines for AI that include "LLM-as-a-Judge" testing. • Leverage frameworks to score agent outputs for accuracy, hallucination, and safety before deployment. • Observability: Instrument applications with tracing tools to visualize agent reasoning chains, monitor latency, and debug failures in production. • Cost Optimization: Monitor token usage and latency, optimizing prompt density and caching strategies to maintain high performance at sustainable costs. • Innovation & Collaboration: Prototyping to Production: Rapidly validate new ideas using state-of-the-art models, then refactor successful prototypes into maintainable, tested production code. • Standards Adoption: Stay ahead of the curve by evaluating emerging technologies to standardize agent connectivity.

Job Requirements

  • Core Engineering: Bachelor’s degree and 5 years of software engineering experience, with exposure to AI/ML applications OR 9 years of software engineering experience, with exposure to AI/ML applications.
  • AI Specialization: 2+ years specifically building with LLMs, with deep familiarity in: Orchestration: LangChain, LangGraph, or similar state-based frameworks.
  • Vector DBs: Pinecone, Weaviate, or pgvector.
  • Prompt Engineering: Advanced techniques (Chain-of-Thought, ReAct, Few-Shot).
  • Production Mindset: Experience not just building demos, but operating them. You know how to handle rate limits, context window overflows, and non-deterministic errors.
  • Soft Skills: Ability to explain "probabilistic software" to non-technical stakeholders—managing expectations that agents are never 100% accurate, but can be 100% useful.
  • Excellent communication skills, with experience in documenting technical designs, sharing insights, and enabling team knowledge transfer.

Benefits

  • Opportunity to design and build the next generation of enterprise AI agents.
  • A collaborative environment where experimentation and innovation are encouraged.

Related Job Pages

More AI Engineer Jobs

Senior AI Engineer

Prokeep

Where Distributors Get More Work Done

AI Engineer51 days ago
Full TimeRemoteTeam 51-200Since 2016H1B No Sponsor

Senior AI Engineer integrating AI into core product for distributors.

ElixirPostgresPythonReact
United States

Senior/Staff AI Engineer

Homebound

Homebound is the first tech-powered homebuilding company of its kind—now building in CA, TX, CO and FL.

AI Engineer51 days ago
Full TimeRemoteTeam 51-200H1B Sponsor

Senior AI Engineer building LLM-powered applications for residential construction.

PandasPythonPyTorchScikit-LearnSparkTensorflow
United States
$143.5K - $227K / year

Machine Learning Engineer – AI Platform Lead

Artera.net

Artera is a Swiss ISP that produces premium hosting and cloud services.

AI Engineer51 days ago
Full TimeRemoteTeam 11-50Since 2002H1B No Sponsor

Machine Learning Engineer developing scalable AI solutions for cancer therapy

AWSDockerKubernetesNode.jsPythonPyTorchRayTensorflowTerraform
United States
$180K - $220K / year

AI Engineer

HighlightTA

Your on-demand talent team.

AI Engineer51 days ago
Full TimeRemoteTeam 1-10Since 2024H1B No Sponsor

AI Engineer shaping the future of non-profit intelligence through AI and ML solutions

AWSCloudJavaScriptNode.jsPython
United States
$90K - $105K / year