Freelance Expert Consultant (AI Training & Evaluation)
Location
New York
Posted
10 days ago
Salary
Not specified
Job Description
We are building the next generation of AI agents capable of navigating the complex consulting tasks.
To achieve this, we are looking for consultants with 5+ years of experience at McKinsey & Company, Boston Consulting Group, or Bain & Company.
The role is not client-facing and does not involve stakeholder management. Instead, the consultant will use their direct experience from real consulting projects to:
- Recreate realistic consulting project environments
- Design structured problem-solving tasks
- Define what high-quality outputs should look like
- Evaluate AI-generated outputs against consulting standards
Why an MBB Background Matters
Practical knowledge of how consulting projects actually work in detail is required. Specifically:
- How ambiguous client questions are translated into structured workplans
- How hypotheses are formed and tested
- How data gaps are handled in real projects
- What “good” looks like in slide decks, models, and executive summaries
- How trade-offs and recommendations are developed under uncertainty
The AI must be trained on environments that reflect real consulting complexity. Only someone who has worked on multiple MBB projects can reliably recreate this level of realism.
While we value all analytical backgrounds, this role specifically requires first-hand MBB project experience.
What You’ll Do
Design realistic consulting environments
- Create detailed project scenarios (industry context, financials, constraints, incomplete information)
- Develop structured tasks such as market sizing, due diligence, cost reduction, growth strategy, or operational diagnosis
Define what “good” looks like
- Set clear evaluation criteria for high-quality consulting outputs
- Distinguish between superficial answers and consulting-grade reasoning
Evaluate AI outputs
- Review analyses and identify logical errors, weak assumptions, and structural gaps
- Provide precise, actionable feedback to improve system performance
Continuously improve training quality
- Refine scenarios, edge cases, and evaluation frameworks
- Increase realism based on real project experience
Skills & Requirements
- 5+ years at McKinsey, BCG, or Bain
- Strong structured problem-solving skills
- Ability to translate vague problems into clear analytical steps
- High attention to logical consistency
- Independent working style
Basic technical familiarity required:
- Reading structured formats (e.g., JSON or YAML)
- Basic Git/GitHub usage
- Clear written English (B2+)
What This Role Is Not
- No client interaction
- No stakeholder management
- No sales or business development
- No team leadership responsibilities
This is a focused analytical role for consultants who want to apply their problem-solving skills to advanced AI systems.