Strategy Consultant – AI Training & Evaluation

About the role

Join Toloka AI’s new Management Consulting domain to translate real‑world consulting engagements into structured learning environments for advanced AI systems. This remote, project‑based position is designed for seasoned strategy consultants who can turn authentic project experience into end‑to‑end AI training scenarios.

Key responsibilities

• Build realistic consulting project environments by creating detailed scenarios that include industry context, financial data, constraints, conflicting inputs, and incomplete information.
• Design structured consulting tasks for AI agents, breaking projects into discrete activities such as market sizing, commercial due diligence, cost optimization, growth strategy, operational diagnosis, and benchmarking.
• Define evaluation criteria and quality standards, developing grading frameworks, rubrics, and golden‑answer solutions to train and calibrate an LLM‑based grading system.

Required profile

• 3+ years of hands‑on consulting experience at a top‑tier firm (McKinsey, BCG, Bain, Oliver Wyman, Roland Berger, Monitor Deloitte, EY‑Parthenon, Kearney, Strategy&).
• Proven ability to structure ambiguous client problems, build financial models or market analyses, and deliver client‑ready recommendations under tight deadlines.
• Comfort with forming and defending recommendations in uncertain environments.
• No deep technical background required; onboarding on lightweight tools will be provided.

Required skills

What we offer

• Opportunity to shape how next‑generation AI learns high‑level business reasoning.
• Fully remote work with flexible project‑based engagement.