Built from open data
29 open datasets and public APIs power this site — no scraping, no closed feeds. We pull CC-licensed research data (Epoch AI), public REST APIs (OpenRouter, Hugging Face Hub), and government/nonprofit statistics (Our World in Data, IFR), normalize them on a daily build, and cite every one below. If a number appears on THE GRADIENT, it traces back to a row in this table. As of 2026-08-26.
Open sources
29 in use| Name | Domain | Category | What it provides | License | Priority |
|---|---|---|---|---|---|
| Epoch AI Companies | Ai | companies | Frontier AI company revenue valuation funding staff compute notes | CC-BY-4.0 cite Epoch AI | ●●● |
| Epoch AI Company Funding Rounds | Ai | funding | Funding rounds for AI companies | CC-BY-4.0 | ●●● |
| Epoch AI All Models | Ai | models | Historical ML/AI model database params compute accessibility org dates | CC-BY-4.0 | ●●● |
| Epoch AI Data Centers | Hardware | datacenters | AI datacenters compute power construction timelines | CC-BY-4.0 | ●●● |
| Epoch AI GPU Clusters | Hardware | gpu_clusters | Large GPU clusters and supercomputers | CC-BY-4.0 | ●●● |
| OpenRouter Models API | Ai | pricing | Live routed model catalog pricing context modality architecture | Public API catalog; rankings/data API licensing separate | ●●● |
| AI Pricing Guru JSON | Ai | pricing | Daily verified model pricing dump | Free for editorial/research/internal with attribution; commercial redistribution may need permission | ●●● |
| Arena AI / LMArena daily snapshots | Ai | benchmarks | Daily JSON snapshots of Arena leaderboards | MIT on snapshot repo; attribute Arena/LMSYS carefully | ●●● |
| Hugging Face Hub API downloads/likes | Ai | adoption | Model metadata downloads likes tags | HF terms | ●●● |
| Stanford CRFM FMTI | Ai | transparency | Foundation Model Transparency Index indicators and scores | See repo license; research citation needed | ●●● |
| Epoch Robotics Models CSV | Robotics | models | Robotics manipulation / policy models with compute and org fields | See Epoch research repo terms; cite Epoch | ●●● |
| Epoch Robotics vs Frontier Compute Chart CSV | Robotics | compute | Robotics model compute compared with frontier AI models | Cite Epoch AI | ●●● |
| Open X-Embodiment (OXE) | Robotics | datasets | Large open real-robot trajectory dataset across many robots/labs | Dataset/project terms; cite OXE | ●●● |
| Our World in Data Industrial Robot Density | Robotics | stats | Industrial robots in operation per 1000 employees by country/year | OWID terms / cite OWID + underlying IFR where required | ●●● |
| Our World in Data Annual Industrial Robot Installs | Robotics | stats | Annual industrial robot installations by country/year | OWID terms / cite OWID + underlying IFR where required | ●●● |
| Epoch AI Benchmark Package | Ai | benchmarks | Packaged benchmark results with historical depth | CC-BY-4.0 for Epoch-owned portions; embedded benches may differ | ●●○ |
| Epoch AI Chip Sales | Hardware | chips | AI chip sales and related financial/disclosure data | CC-BY-4.0 | ●●○ |
| Epoch AI Chip Owners | Hardware | chips | Who owns/controls AI chip capacity | CC-BY-4.0 | ●●○ |
| Epoch AI ML Hardware | Hardware | accelerators | 170+ AI accelerators GPUs TPUs specs | CC-BY-4.0 | ●●○ |
| Hugging Face Open LLM Leaderboard datasets | Ai | benchmarks | Open-weight eval results datasets | Open / dataset-specific | ●●○ |
| OECD AI Incidents Monitor | Ai | incidents | Monitored AI incidents and hazards | OECD terms | ●●○ |
| AI Incident Database (AIID) | Ai | incidents | Community AI harm/near-harm index | Project terms | ●●○ |
| arXiv API | Ai | papers | Paper metadata/search cs.AI cs.LG etc | arXiv terms | ●●○ |
| OpenVLA | Robotics | models | Open vision-language-action model trained on OXE-scale robot data | Project license on release artifacts | ●●○ |
| NVIDIA Physical AI Autonomous Vehicles dataset | Robotics | datasets | Large multimodal AV/physical AI dataset on Hugging Face | NVIDIA / HF dataset terms | ●●○ |
| Epoch AI Chip Components | Hardware | chips | AI chip component dataset | CC-BY-4.0 | ●○○ |
| Epoch AI Usage Polling | Ai | usage | Polling on AI use at work | CC-BY-4.0 | ●○○ |
| Awesome Robotics Foundation Models | Robotics | survey | Curated list of robotics foundation models papers/code | Repo license | ●○○ |
| Awesome LLM Robotics | Robotics | survey | Curated papers/code for LLMs multimodals in robotics | Repo license | ●○○ |
Other sources we track
14 candidatesThese are on our radar but not used for published numbers yet — grouped by why they're not live.
VERIFY (8)
Terms or licensing unconfirmed — tracked as candidates, not yet pulled into the site.
| Name | Domain | What it provides | Note |
|---|---|---|---|
| OpenRouter Rankings / Data API | Ai | Real-world usage rankings and related analytics | Docs claim CC BY 4.0 for Data API returns |
| AI Model Pricing.com free API claim | Ai | Claimed broad free model pricing API | unknown |
| Aider Polyglot leaderboard | Ai | Practical coding-model leaderboard | Apache 2.0 claimed in prior notes |
| IFR World Robotics | Robotics | Official industrial/service robot statistics reports | IFR terms |
| China Humanoid Robotics Tracker | Robotics | Tracker of China humanoid robot companies funding products supply links | Site terms unknown |
| Awesome MCP server lists / registries | Shared | MCP server catalogs stars categories | repo-specific |
| YC / startup directories | Shared | Startup discovery pages | YC terms |
| Company filings crumbs (Companies House / SEC EDGAR) | Shared | Ownership structure filings for selected firms | public records terms |
GATED (3)
Requires a paid tier or restricted access beyond free exploration — not used for published numbers.
| Name | Domain | What it provides | Note |
|---|---|---|---|
| Artificial Analysis API | Ai | Independent indexes latency throughput cost-per-task | Free exploration claimed; commercial redistribution may need paid package |
| Provider native model lists (Groq/Together/Fireworks) | Ai | Provider model endpoints for cross-checks | Provider terms |
| Semantic Scholar API | Ai | Paper search citations metadata | Semantic Scholar terms |
SIGNAL (3)
Used only for story leads and demand signal, never cited as a data point.
| Name | Domain | What it provides | Note |
|---|---|---|---|
| X / @grok asks | Shared | Demand signal for comparisons fact-checks pricing launches | X terms |
| Reddit AI / robotics subs | Shared | Pain points source tips product discovery | Reddit terms |
| Lab blogs / release notes | Shared | Primary announcements for models robots hardware | publisher terms |
Attribution
Data from Epoch AI (AI companies, funding, models, GPU clusters, data centers, ML hardware, and robotics datasets) is used under CC BY 4.0. See epoch.ai for full terms and methodology.
Robot adoption statistics are from Our World in Data, sourced from the International Federation of Robotics (IFR) World Robotics report. Cite both OWID and IFR when reusing this data — see ourworldindata.org.
Model pricing and catalog data is pulled live from the OpenRouter public API and cross-checked against AI Pricing Guru. Open-weight popularity signal comes from the Hugging Face Hub API.
THE GRADIENT republishes derived aggregates and summaries of the above, not raw redistributions, and links back to every original source. Nothing here is sold or paywalled.
Know an open dataset we should track? File an issue.