TA
The Aggregate — LLM benchmark aggregate
8 endpointsliveFused LLM rankings: one IRT/Elo scale across ~5,000 public benchmark leaderboards, updated daily. (MCP server ai.theaggregate/the-aggregate, aggregated from the official registry)
$Set up https://cracked-ai-pearl.vercel.app/SKILL.md, and then use Cracked to show me what I can do for The Aggregate — LLM benchmark aggregate.
| Endpoint | What it does | Price | Health |
|---|---|---|---|
| Aggregate leaderboard /get_leaderboard verified | Top of the cross-benchmark aggregate ranking: every model placed on one Elo scale by an IRT model fit over ~5,000 public benchmark leaderboards. One row per mod | $0.0020 per call | unknown |
| Search models /search_models verified | Find ranked models by (partial) name or provider. Returns rank, Elo and the model page URL. One row per model by default, fused across reasoning-effort settings | $0.0020 per call | unknown |
| Model profile /get_model verified | One model in depth: aggregate rank, Elo with standard error, provider, what it is, cost per task where known, and its most notable benchmark results (with perce | $0.0020 per call | unknown |
| Compare models /compare_models verified | Head-to-head between 2-4 models: aggregate ranks, Elo gap with a significance note based on the standard errors, and notable benchmarks they share. | $0.0020 per call | unknown |
| Search benchmarks /search_benchmarks verified | Find benchmarks in the aggregate by (partial) name. Returns model coverage, difficulty on the Elo scale, and the benchmark page URL. | $0.0020 per call | unknown |
| Benchmark detail /get_benchmark verified | One benchmark in depth: what it measures, the original source leaderboard URL, IRT stats (difficulty, noise, model coverage), skill weights, and the current top | $0.0020 per call | unknown |
| Prediction duel standings /get_prediction_duel verified | Guesswork — the public prediction duel: every day frontier LLMs and The Aggregate's own IRT model predict newly scraped benchmark scores before seeing them, and | $0.0020 per call | unknown |
| About The Aggregate /about_the_aggregate verified | What this data is: how the IRT fusion works, current coverage counts, update cadence, and how to cite it. | $0.0020 per call | unknown |