DATA 2027 · Week 14 · Part IV — Frontier & Futures

What Goes Around

Every rebellion ends the same way: SQL grows a type, the engine grows an index — is the agentic era lap seven, or the first genuine exception?

Lecture 1 — Fifty Years of Data-Model Rebellions · Lecture 2 — Final Debate: the First Genuine Exception?

Lecture 1 · Tuesday

Fifty Years of Data-Model Rebellions

Stonebraker wrote the same paper twice, nineteen years apart. Both times he was right.

L1 · The Cycle

The paper written twice

L1 · The Cycle

You can set a tenure clock by it

L1 · Lap One

Codd’s rebellion-that-stuck

L1 · Lap Two

Objects: the impedance mismatch

L1 · Lap Three

XML: the purest specimen

L1 · Lap Four

MapReduce rebelled against the engine

L1 · Lap Five

NoSQL: the decade of rediscovering ACID

L1 · The Asymmetry

Why the cycle always closes

≈10y vs 2

a rebellion needs ~ten years to rebuild recovery, concurrency, statistics, drivers, a planner — the incumbent bolts the one good idea into a socket in ~two release cycles.

L1 · Reabsorption

Three extension sockets

TYPE SYSTEM XML · JSON · vector ACCESS METHODS GiST · GIN · R-tree · HNSW OPTIMIZER RULES new operator gets costed SQL ENGINE cheaper than a migration the asymmetry is structural, not sentimental
Fig. 1 — Never bet against SQL absorbing a feature; bet only on whether the feature was real.
L1 · Scorecard

Six laps, one ending

Rebellion (peak)The real painHow SQL absorbed it
Hierarchical / CODASYL (1968–80)— (incumbent)n/a — relational won outright
OODB (1988–98)impedance mismatchSQL:1999 structured types; ORMs
XML (1998–2008)semi-structured dataSQL/XML:2003 type + indexes
MapReduce (2004–14)petabyte scaleSQL-on-Hadoop; warehouse scale-out
NoSQL (2007–15)planet-scale writesJSON in SQL:2016/2023; distributed SQL
Graph (2010–)multi-hop traversalSQL:2023 SQL/PGQ — in real time
L1 · Reabsorption

The reabsorption cycle

WORKLOAD PAIN (the rebels are right) REBEL MODEL + REBEL LANGUAGE REBEL RE-GROWS TXNS, SCHEMA, OPTIMIZER (~10y) SQL GROWS A TYPE, ENGINE GROWS AN INDEX one lap ≈ ten years OODB · XML · MapReduce · NoSQL … XML took 10y; vectors took 1.5y exception? (open algebra, $ costs)
Fig. 2 — Five rebellions completed the lap; the dashed exit has never been taken.
L1 · Field Note

The “native XML” policy store

Lecture 2 · Thursday

Final Debate: the First Genuine Exception?

Resolved: vectors, semantic operators, and agent memory are the next XML.

L2 · The Resolution

Steelman, don’t strawman

L2 · Absorption

Exhibit one: pgvector

18 months

pgvector 0.5 shipped HNSW in 2023; within a year Oracle, SQL Server, MySQL, DuckDB, and the cloud warehouses all had a vector type and an ANN index — the XML choreography, executed in eighteen months instead of ten years.

L2 · Absorption

Exhibits two and three

  • SQL/PGQ: graph absorbed into the 2023 standard.
  • Absorbed while the debate was still running.
  • Vector DBs already pivoting to “AI data platforms.”
  • Semantic operators = expensive UDFs.
  • WHERE llm_judge(review, …) — scalar function, weird cost.
  • Hellerstein costed expensive predicates in the early 1990s.
L2 · Absorption

Three “dead” rebellions, one statement

-- 2026, one engine, one statement
SELECT p.sku, p.meta->>'title' AS title,
       embedding <=> :query_vec AS dist
FROM   products p
WHERE  p.meta @> '{"status":"active"}'   -- the JSON rebellion
ORDER  BY embedding <=> :query_vec        -- the vector rebellion
LIMIT  20;                                -- HNSW scan, costed like any other

Agents speak SQL through MCP — we taught the new client the old language.

L2 · Exception

1. Accuracy is now in the result

L2 · Exception

2. Operators now cost dollars

$7,500

one semantic join over a 10⁴ × 10⁴ pair space = 10⁸ model calls ≈ $7,500 for a single query. Plan choice is now a procurement decision.

L2 · Exception

The arithmetic, per row

L2 · Exception

3. The algebra is no longer closed

L2 · Field Note

The index that disagreed with itself

4%

a silent model-version bump flipped 4% of cached semantic-filter verdicts — and a downstream aggregate a procurement agent acted on. The fix: pin model versions like schema versions; treat an upgrade as a migration with a backfill.

L2 · Refereeing

Three tripwires, five years

L2 · Thesis

The course thesis, restated

L2 · Open Problems

Three problems worth a PhD

Every rebellion thought it was killing SQL. Every rebellion ended as a column type and an access method.
— Week 14, Lecture 1
L2 · Checkpoint

Before the debate

L2 · Readings

Read before Thursday