Freelance Expert Consultant (AI Training & Evaluation)

Part TimeRemoteCompany Site

Location

New York

Posted

10 days ago

Salary

Not specified

English

Job Description

We are building the next generation of AI agents capable of navigating the complex consulting tasks.

To achieve this, we are looking for consultants with 5+ years of experience at McKinsey & Company, Boston Consulting Group, or Bain & Company.

The role is not client-facing and does not involve stakeholder management. Instead, the consultant will use their direct experience from real consulting projects to:

  • Recreate realistic consulting project environments
  • Design structured problem-solving tasks
  • Define what high-quality outputs should look like
  • Evaluate AI-generated outputs against consulting standards

Why an MBB Background Matters

Practical knowledge of how consulting projects actually work in detail is required. Specifically:

  • How ambiguous client questions are translated into structured workplans
  • How hypotheses are formed and tested
  • How data gaps are handled in real projects
  • What “good” looks like in slide decks, models, and executive summaries
  • How trade-offs and recommendations are developed under uncertainty

The AI must be trained on environments that reflect real consulting complexity. Only someone who has worked on multiple MBB projects can reliably recreate this level of realism.

While we value all analytical backgrounds, this role specifically requires first-hand MBB project experience.

What You’ll Do

Design realistic consulting environments

  • Create detailed project scenarios (industry context, financials, constraints, incomplete information)
  • Develop structured tasks such as market sizing, due diligence, cost reduction, growth strategy, or operational diagnosis

Define what “good” looks like

  • Set clear evaluation criteria for high-quality consulting outputs
  • Distinguish between superficial answers and consulting-grade reasoning

Evaluate AI outputs

  • Review analyses and identify logical errors, weak assumptions, and structural gaps
  • Provide precise, actionable feedback to improve system performance

Continuously improve training quality

  • Refine scenarios, edge cases, and evaluation frameworks
  • Increase realism based on real project experience

Skills & Requirements

  • 5+ years at McKinsey, BCG, or Bain
  • Strong structured problem-solving skills
  • Ability to translate vague problems into clear analytical steps
  • High attention to logical consistency
  • Independent working style

Basic technical familiarity required:

  • Reading structured formats (e.g., JSON or YAML)
  • Basic Git/GitHub usage
  • Clear written English (B2+)

What This Role Is Not

  • No client interaction
  • No stakeholder management
  • No sales or business development
  • No team leadership responsibilities

This is a focused analytical role for consultants who want to apply their problem-solving skills to advanced AI systems.

Related Categories

Related Job Pages