# Singularity Tracker: open data

Tracking the transition in the age of superintelligence. Ten fields, ten milestones each, every result labeled by who checked it.

- Page: https://primesignal.org/singularity-tracker.html
- Publisher: Prime Signal
- License: [CC BY 4.0](https://creativecommons.org/licenses/by/4.0/). Use, share and adapt it; credit Prime Signal and link to the page.
- Cite as: Prime Signal, Singularity Tracker, updated (date). primesignal.org/singularity-tracker.html

## Files

The CSV files are the source of truth. `tracker.json` and `tracker.db` are generated from them on every build.

| File | What it holds |
|---|---|
| `fields.csv` | The ten fields: stage, time to check a result, what we track, bottom line |
| `milestones.csv` | All 100 milestones and their current state |
| `changes.csv` | Earlier states of milestones that changed, so any past update can be rescored |
| `sources.csv` | Every primary source, with its type |
| `stories.csv` | The update feed |
| `metrics.csv` | Readings over time for the numbers we watch |
| `watch.csv` | Which readings we watch, and why |
| `gatekeepers.csv` | Whether the institution that owns each field's highest bar has signed off |
| `updates.csv` | Each published update |
| `corrections.csv` | What we got wrong, and what we changed it to |
| `abilities.csv` | The eight abilities in the Superintelligence Score, and who AI is compared with |
| `ability_steps.csv` | Three steps per ability that compare AI with people, and their current state |
| `tracker.json` | Everything above in one file, plus scores and the monthly history |
| `tracker.db` | SQLite database of the same tables, with score views |

### milestones.csv

| Column | Meaning |
|---|---|
| `field_id`, `n` | Field and milestone number, 1 to 10. 1 to 2 are Stage 1, 3 to 5 Stage 2, 6 to 8 Stage 3, 9 to 10 Stage 4 |
| `milestone` | What has to happen |
| `status` | `achieved`, `partial` or `not_yet` |
| `verification` | Who checked it: `claimed`, `preprint`, `peer_reviewed` or `replicated`. Empty if not yet reached |
| `reached` | When it happened: `YYYY`, `YYYY-MM` or `YYYY-MM-DD` |
| `outlook` | For milestones not yet reached: the expected window or current state |
| `evidence` | One line of evidence |
| `source_ids` | Sources, separated by `;`, from `sources.csv` |
| `recorded` | The update that first recorded the current status |
| `updated` | The update that last changed the evidence |

### ability_steps.csv

| Column | Meaning |
|---|---|
| `ability_id`, `step` | Ability from `abilities.csv` and step 1 to 3: 1 matches skilled professionals, 2 surpasses the best person or best human design, 3 surpasses whole teams or fields |
| `milestone` | What has to happen. Empty when `ref` is set, unless the step words it its own way |
| `ref` | `field:n` when the step is an Index milestone. The step then takes its status, verification, dates, evidence and sources from `milestones.csv`, and those columns stay empty here |
| other columns | As in `milestones.csv`, for steps with their own evidence |

## Scoring

- An achieved milestone is worth 10 points, a partial one 5. A field's score is its points out of 100.
- The verified score counts only milestones that were peer-reviewed or replicated.
- The Singularity Index is the average of the ten field scores. The verified Index averages the verified scores.
- A field's stage is set by its stage tests, and can never be above the band of its highest achieved milestone.
- The history uses the date each milestone was reached and its current verification level. Dates given as a year sit at mid-year.
- The Superintelligence Score scores ability steps the same way, weighted by step: step 1 counts once, step 2 twice, step 3 three times. Points across all 24 steps, out of 100, with a verified version. It measures how AI compares with people; the Index measures AI's progress in each field.

## Query it

```sh
sqlite3 tracker.db "SELECT name, score, verified_score FROM field_scores ORDER BY score - verified_score DESC;"
```

Views: `milestone_points`, `field_scores`, `tracker_index`, `milestone_sources`, `ability_step_points`, `ability_scores`, `superintelligence_score`. Table `history` holds the monthly Index.

```sql
-- Milestones that rest only on a company's word
SELECT field_id, n, milestone, evidence FROM milestones WHERE verification = 'claimed';

-- Every source behind a field
SELECT n, milestone, label, url FROM milestone_sources WHERE field_id = 'math';
```

## Updates

The Tracker is updated weekly. Each update adds a row to `updates.csv`; changed milestones keep their earlier state in `changes.csv`, and the feed grows in `stories.csv`. Corrections are logged in `corrections.csv`, never made silently.

Found an error? Write to us at primesignal.org/contact.html.