Can AI Reproduce Einstein's Relativity? Researchers Test 'Vintage' Language Models
During the India AI Summit in February, Demis Hassabis, co-founder of Google DeepMind, proposed the idea of training a large language model using knowledge prior to 1911 to evaluate its ability to replicate Einstein's general theory of relativity. This concept expands on Owain Evans' presentation from December 2024 regarding 'historical' LLMs. Independent researcher Michael Hla developed Machina Mirabilis using data from before 1900, which demonstrated limited comprehension. Nick Levine's group encountered challenges with data from before 1930. The Ranke-4B project at the University of Zurich experimented with models limited to data between 1913 and 1946. A July preprint by Ido Kaminer advocates for a reevaluation of model principles for advancements. Meanwhile, MIT's Sendhil Mullainathan discovered that an orbital mechanics model failed to accurately deduce true gravitational laws, although LLMs achieved notable mathematical progress. This article appeared in Nature 657, 338-340 (2026).
Key facts
- Demis Hassabis proposed at the India AI Summit in New Delhi in February that training an LLM on pre-1911 data to reproduce general relativity would be a good test for AGI.
- Owain Evans of Truthful AI in Berkeley, California, gave a December 2024 talk about 'vintage' or 'historical' LLMs trained only on historical data up to a certain date.
- Independent researcher Michael Hla trained an LLM called Machina Mirabilis on pre-1900 data; it showed 'glimpses of intuition' but failed in most cases and lacked true understanding.
- Nick Levine and colleagues attempted a vintage AI model using only pre-1930 knowledge but found training data 'maddeningly leaky,' with the model often correctly answering questions about the 1950s.
- The University of Zurich's Ranke-4B project created historical models with cut-offs of 1913, 1929, 1933, 1939 and 1946; Daniel Göttlich, now at ETH Zurich, says they test for 'sparks of genius.'
- A July preprint by Ido Kaminer of Technion—Israel Institute of Technology in Haifa argues a relativity-like breakthrough is not inherently out of reach but requires rethinking current model principles.
- Google DeepMind researcher Tom Zahavy's January position paper 'LLMs can't jump' highlights that transformative advances require abductive reasoning, not inductive correlation.
- MIT's Sendhil Mullainathan found in a July conference paper that an orbital mechanics model never inferred the true law of gravitation, instead producing a different wrong law for each planetary system.
- In May, an OpenAI chatbot disproved an 80-year-old conjecture by Hungarian mathematician Paul Erdős, which Mullainathan calls a 'genuine conceptual advance.'
- The article was published in Nature 657, 338-340 (2026), doi: 10.1038/d41586-026-02804-x.
Entities
Artists
- Albert Einstein
- Demis Hassabis
- Owain Evans
- Ido Kaminer
- Tom Zahavy
- Thomas Kuhn
- Johannes Kepler
- Isaac Newton
- Sendhil Mullainathan
- Paul Erdős
- Michael Hla
- Nick Levine
- Daniel Göttlich
- Jacob Andreas
- Franklin D. Roosevelt
Institutions
- Google DeepMind
- Truthful AI
- Technion—Israel Institute of Technology
- Massachusetts Institute of Technology (MIT)
- OpenAI
- University of Zurich
- Swiss Federal Institute of Technology (ETH) in Zurich
- Nature
- India AI Summit
Locations
- New Delhi
- India
- London
- United Kingdom
- Berkeley
- California
- United States
- Haifa
- Israel
- Cambridge
- Massachusetts
- San Francisco
- Switzerland
- Zurich