Benchmark detail

One benchmark in depth: what it measures, the original source leaderboard URL, IRT stats (difficulty, noise, model coverage), skill weights, and the current top

liveverifiedunknown~5s typical

mcpprobedtheaggregate—

$0.0020

per call

plus $0.001 platform fee per run

Open MCP server; Cracked bills routing only

Provider Upstream docs

$Set up https://cracked-ai-pearl.vercel.app/SKILL.md, then use Cracked to run mcp-ai-theaggregate-the-aggregate /get_benchmark for me.

Input

Field	Type	Description
benchmark*	string	Benchmark name or slug, e.g. "Aider polyglot".
top	number	How many top models to list (1-50, default 10).

Call it

curl

curl https://cracked-ai-pearl.vercel.app/v1/run \
  -H "Authorization: Bearer ck_live_..." -H "content-type: application/json" \
  -d '{"provider":"mcp-ai-theaggregate-the-aggregate","endpoint":"/get_benchmark","input":{"benchmark":"..."}}'

cli

npx cracked-ai run -p mcp-ai-theaggregate-the-aggregate -e /get_benchmark -i '{"benchmark":"..."}'

mcp

run_tool({ provider: "mcp-ai-theaggregate-the-aggregate", endpoint: "/get_benchmark", input: {"benchmark":"..."} })

Try it

Runs against your signed-in workspace balance. Sign in if you have not.