// agentic engineering assessment
Measure agentic engineering skill on a real AI product.
Candidates get a running agentic product (an agent with tools, retrieval, evals and traces) and its production issues: wrong answers, broken tool calls, evals that pass while users complain. With a coding agent at their side, they debug, fix and ship. You see how they find the root cause, what they verify, and how they recover.
For engineering teams that hire. We'll write once, when pilots open.
Timeline
A real agentic product
Not a toy repo, not puzzles. A running AI product with an agent, tools, retrieval, evals and traces, spun up fresh for every candidate.
Real production issues
Hallucinated answers, stale retrieval, tool loops, evals that cannot fail. Several incidents, the kind your team gets paged for.
Evidence per skill
Root-causing, eval design, directing the coding agent, recovery: each gets a level, with prompts verbatim and what production said. You decide.
Puzzles measure what the agent already does. We measure what the engineer adds.