Introduction
You live in a world governed by quantum mechanics, yet the foundational theory of modern physics remains incomplete and paradoxical. While you rely on quantum technology every day, physicists still argue over what actually happens when no one is looking. Lee Smolin argues that quantum mechanics requires a realist completion because standard interpretations abandon the idea of a real world existing independently of observers.
The book traces the historical triumph of the Copenhagen orthodoxy, explains the limits of current quantum rules, and examines realist alternatives like pilot wave theory and relationalism. You will find answers to the following questions as you read:
- Why does quantum mechanics fail to describe individual events in nature?
- How did the physics community suppress realist alternatives for nearly a century?
- What experiments prove that quantum entanglement defies ordinary locality?
- How can physics be rebuilt on background-independent principles and genuine time?
1. Quantum Mysteries and the Measurement Problem
Quantum mechanics serves as the indispensable foundation of modern physics and biology. For nine decades, it has remained the core of our understanding of nature. You rely on this framework when you study atoms, chemical bonding, materials science, radioactivity, and DNA. The standard model of particle physics rests entirely upon its rules. However, its core concepts challenge everyday intuition by suggesting that particles lack definite properties until observed.
Quantum mechanics provides the foundation of modern physics while remaining plagued by deep conceptual paradoxes regarding the nature of reality.
Quantum Weirdness
Quantum systems exhibit superposition and entanglement. They exist in multiple potential states simultaneously and share deeply intertwined properties that defy classical physics. Superposition allows a quantum particle to act as a wave and be in multiple places at once. A measurement forces it into a definite position. Entanglement binds separate particles so intimately that their properties cannot be separated into individual descriptions.
The Measurement Problem
The measurement problem highlights an unresolved contradiction between the weird, probabilistic quantum world and the definite, classical world of large measuring devices. This problem has been controversial and unresolved since the 1920s. While microscopic objects exist in quantum superpositions, macroscopic measuring instruments always register a single, definite outcome. Physics lacks a universally agreed-upon explanation for where and how the transition between the quantum and classical realms occurs.
Realism vs Anti-Realism
Physicists are fundamentally divided into realists and anti-realists. Realists believe matter has stable properties independent of observers. Anti-realists argue that quantum theory only describes our knowledge or interactions. Realists like Albert Einstein and the author maintain that science should provide a complete description of an objective external reality. Anti-realists include quantum epistemologists, operationalists, naive realists, and magical realists. They argue that quantum mechanics is complete and that properties are created only through measurement or reflection of human knowledge.
Albert Einstein rejected quantum mechanics as a definitive theory. He argued instead that it offers an incomplete statistical description missing crucial hidden variables. Because Einstein believed in an objective reality operating independently of human observation, he famously stated that God does not play at dice in 1926. In 1935, Einstein and two collaborators published a paper sparking theoretical and experimental developments regarding locality. This triggered forty years of passionate debate between Einstein and Niels Bohr until Einstein's death.
2. Principles of Quantum Rules and Change
Classical physics operated on the Newtonian paradigm where knowing complete initial conditions allowed precise predictions of the future. Tom Stoppard's play Arcadia is cited where heroine Thomasina explains that if one could stop every atom and use algebra, a formula for all the future could exist. Quantum theory shatters this determinism by establishing that information needed to describe a physical system comes in complementary pairs. You can only ever measure or know one of them.
Uncertainty and Non-Commutativity
The uncertainty principle states that the more precisely you know one variable of a pair, the less precisely you can know the other, because measuring them involves non-commutative operations.
Measuring one variable randomizes or disrupts the value of the other variable if measured subsequently. Operations are non-commutative when the order in which they are performed matters. Putting on underwear and pants involves non-commutative operations, whereas putting on socks commutes with everything except putting on shoes.
Quantum objects exhibit a wave-particle duality where they can be visualized either as localized particles with definite positions or as pure waves with definite momentum. A particle with a definite momentum and indefinite position is visualized as a wave vibrating at a single frequency. The wavelength is inversely proportional to momentum divided by Planck's constant, while energy is proportional to frequency. Large molecules such as buckyballs and proteins have successfully demonstrated their quantum nature through experiments amidst 10^28 atoms and molecules in the air of a room.
The Two Rules of Change
Isolated quantum states evolve deterministically in time according to Rule 1, while measurements introduce fundamental randomness via the Born rule and cause the wave function to collapse according to Rule 2.
Rule 1 is also known as the Schrödinger equation or unitarity. While individual measurement outcomes are probabilistic, the evolution of the quantum state of an isolated system between measurements follows a precise, deterministic law. Rule 2 is abrupt, probabilistic, and collapses superpositions into definite values upon measurement. Measuring an electron's momentum and finding it moving north with a momentum of 17 immediately places the system into a definite northward momentum state.
The probability of finding a particle at a location is proportional to the square of the height of its wave function at that point. Because measurements are physical processes, giving them a special foundational role conflicts with realism.
What Quantum Mechanics Explains
Quantum mechanics fundamentally predicts statistical averages over ensembles of identically prepared systems rather than describing individual deterministic outcomes. Quantum theory deals with ensembles where particles have discrete spectra of energies or statistical position distributions calculated by squaring the wave function. It explains averages without necessarily telling you what happens in individual cases. Comparing human height statistics to quantum measurement shows that while height averages stem from known individual facts, quantum averages lack stories for individual cases. 95 percent is the proportion of Canadians comfortable if seats were built using average and standard deviation.
Preparing a million different hydrogen atoms in the ground state and measuring electron positions yields a statistical distribution clustered around the proton rather than a single predictable position.
3. Entanglement, Locality, and Contextuality
Quantum Entanglement
Quantum mechanics allows composite systems to exist in entangled states where you know how the parts relate while having zero information about each part individually. When combining two systems like an electron and a proton, the joint quantum state represents half the possible information, leading to new phenomena. In the CONTRARY state, individuals have indefinite properties, but their correlations are entirely certain.
Anna and Beth share an apartment and are individually cat lovers with indefinite political views. In the CONTRARY state, whenever they are asked the same question, they always disagree, while their individual answers appear completely random.
Nonlocality and Bell's Theorem
John Bell proved mathematically that quantum mechanics violates the principle of locality, meaning that measurements on one particle can instantly affect another far away. Bell introduced an assumption that information cannot travel faster than light and derived a restriction on particle correlations. Quantum mechanical predictions violate this restriction, proving that physical locality is false. John Bell wrote a paper in 1964 showing that pairs of photons in the CONTRARY state disagree whenever tested with the same polarization angle, which cannot be explained by prior agreement.
The EPR Argument and Contextuality
Einstein, Podolsky, and Rosen argued in 1935 that quantum mechanics is incomplete because it cannot simultaneously describe all elements of physical reality while maintaining locality. The EPR criterion states that if you can determine a property with 100 percent certainty without disturbing a system, it is an element of physical reality. Assuming locality, measuring Beth instantly defines Anna's state without physical contact, proving both pet and political preferences are real, which quantum states cannot simultaneously capture.
Bell's theorem and definitive experiments prove that nature violates locality, revealing that quantum mechanics is inherently contextual and incomplete.
EPR used a thought experiment involving particles to argue that quantum states incompletely describe reality. Alain Aspect, along with Jean Dalibard, Philippe Grangier, and Gérard Roger, carried out definitive experiments in Orsay near Paris in the early 1980s. Aspect used laser-excited atoms producing pairs of entangled photons flying in opposite directions through freely set polarizers. The results cleanly violated Bell's restriction and agreed with quantum theory.
Schrödinger's cat highlights the measurement problem by showing the absurdity of applying quantum superposition rules to large macroscopic animals and measuring devices. When an atom in a superposition triggers a Geiger counter connected to a lethal device, applying Rule 1 implies the cat inside the box is in a superposition of alive and dead until observed, exposing the contradiction between the two quantum rules. Schrödinger's thought experiment places a cat, an atom, a Geiger counter, and a transformer in a closed box to test whether macroscopic systems exist in superpositions.
Quantum mechanics is inherently contextual, meaning the answer given to a measurement depends on the overall context of which other compatible measurements are chosen. If a property A is compatible with both B and C, but B and C are incompatible with each other, the measured values of A depend on whether B or C was measured alongside it. This Bell-Kochen-Specker theorem rules out large classes of realist theories. John Bell proved contextuality in the early 1960s before it was independently proved by mathematicians Simon Kochen and Ernst Specker, following two years the paper was lost on the editor's desk before publication in 1966.
4. The Rise of the Copenhagen Orthodoxy
The historical development of wave mechanics and matrix mechanics culminated in the anti-realist Copenhagen interpretation and the suppression of hidden variables.
Origins of Quantum Theory
Light exhibits a dual nature, traveling like a wave while carrying energy in discrete packets called photons whose energy is proportional to their frequency. Einstein expanded on Maxwell's wave theory of light and Planck's black-body derivation by proposing that light energy comes in discrete quanta. The photoelectric effect proved that electrons are liberated from metal only when the light frequency crosses a specific threshold, regardless of how intense the light beam is. Thomas Young used the double slit experiment to prove light is a wave through diffraction patterns, while Einstein explained the photoelectric effect in 1905 during his patent office years. This foundation rests on several historical milestones:
- 1905: Einstein's miracle year when he wrote four monumental papers
- 1902: Measurements carried out showing liberated electron energy proportional to frequency over threshold
- 1921: Einstein awarded the Nobel Prize for the photoelectric effect
Niels Bohr solved the crisis of atomic stability by postulating that electrons orbit in stable stationary states corresponding to integer multiples of Planck's constant. According to classical Maxwellian electrodynamics, orbiting electrons should continuously radiate energy and spiral into the nucleus. Bohr resolved this by assuming Maxwell's theory fails on atomic scales and dictating that electrons only emit or absorb discrete packets of light when jumping between stable stationary states. Ernest Rutherford determined the nucleus is tiny compared to the whole atom in 1911. Bohr worked out the spectrum of hydrogen in 1912, successfully reproducing what experimentalists had observed.
Wave Mechanics and Matrix Mechanics
Louis de Broglie hypothesized that the wave-particle duality is universal, meaning that electrons and all matter behave as waves as well as particles. De Broglie proposed that particles do not move in strict straight lines because they are guided by waves that diffract and refract around obstacles. His doctoral thesis was reviewed and approved after Einstein recommended it, following his return to theoretical physics studies in 1920 and the completion of his short and uncompromising PhD thesis in 1924. Bell Labs experimentalists Clinton Davisson and Lester Germer accidentally discovered electron diffraction when scattering electrons off a metal surface with a regular crystal layer in 1925, confirming de Broglie's prediction.
Erwin Schrödinger formulated the fundamental wave equation of quantum theory to describe how electron waves travel in space. Inspired by Peter Debye's presentation of de Broglie's hypothesis on November 23, 1925, Schrödinger spent a Christmas holiday in the mountains with his girlfriend deriving the wave equation and successfully reproducing Bohr's stationary states. Schrödinger left his wife behind in Zurich while she spent the holidays with her lover Hermann Weyl, who later helped Schrödinger solve his equation. Werner Heisenberg constructed quantum mechanics using matrices of observable quantities, arguing that physics should only track what can be measured rather than unobservable electron trajectories. Working on the island of Helgoland in 1925, Heisenberg realized that properties like position and momentum could be represented as tables of numbers that do not commute before Max Born and Pascual Jordan recognized them as matrices. Heisenberg tested his ideas on a simple toy model of an atom bound by a spring-like force before generalizing it.
The Copenhagen Orthodoxy
Niels Bohr and his followers established the anti-realist Copenhagen interpretation, arguing that science describes our interactions and relationships with nature rather than an objective external reality. Bohr introduced the principle of complementarity, stating that mutually exclusive pictures like waves and particles are required depending on the experimental context. Heisenberg's uncertainty principle mathematically safeguarded this by proving that position and momentum cannot be known simultaneously after moving back to Copenhagen in 1927. Bohr and Einstein held intense, informal discussions at the Solvay conferences, debating whether quantum mechanics provided a complete description of reality before the quantum revolutionaries became senior professors and the revolution was complete by 1930.
John von Neumann published a mathematically flawed proof claiming hidden variables were impossible, which suppressed alternative realist theories for decades until exposed by Grete Hermann. Von Neumann's theorem assumed axioms that were already equivalent to the core structure of quantum mechanics, thereby only proving that any theory equivalent to quantum mechanics is equivalent to it. David Bohm and John Bell later independently rediscovered that von Neumann's proof contained a fatal and foolish assumption, two decades after the error first required notice.
5. Realist Alternatives and Quantum Foundations
Pilot wave theory, physical collapse models, and relational frameworks offer realist completions of quantum mechanics that resolve paradoxes without observers.
Pilot Wave Mechanics
Louis de Broglie presented the pilot wave theory at the Fifth Solvay Conference in Brussels in 1927, where it was met with general neglect. In pilot wave theory, an electron consists of both a particle and a wave. The wave propagates deterministically via Schrödinger's equation, while the particle is guided along the path of steepest ascent. This deterministic framework yields Max Born's probability law as a natural consequence without requiring wave function collapse.
David Bohm successfully formulated a realist completion of quantum mechanics in 1952 by reviving and expanding de Broglie's pilot wave theory. Bohm developed these revolutionary papers while working as an assistant professor and after facing political persecution, ultimately publishing them while isolated in São Paulo, Brazil. Because the theory is deterministic, probabilities arise entirely due to uncertainty about exact initial particle locations, behaving similarly to statistical mechanics and thermodynamic equilibrium through Antony Valentini's theorems. While one branch guides the actual particles of a physical system, all other divergent branches continue to evolve as empty, unpopulated wave functions. Smolin reflects on how a radioactive decay decision led him to move to Toronto, leaving an empty branch of his wave function inhabiting London and another resting at the bottom of St. Margarets Bay from a missed plane crash.
Physical Collapse and Quantum Gravity
Physical collapse models modify quantum mechanics by combining rules into a single continuous evolution law where large systems undergo spontaneous, objective collapses. Jeffrey Bub and David Bohm proposed the first collapse model in 1966, followed by Philip Pearle's continuous spontaneous localization theory and the GRW theory proposed by Ghirardi, Rimini, and Weber. Roger Penrose proposed that the physical collapse of the quantum state is fundamentally driven by gravitational discrepancies inherent in multi-fingered time. Penrose pioneered revolutionary mathematical tools in general relativity, proved singularity theorems with Stephen Hawking, and invented spin networks and twistor theory.
The Quantum Foundations Renaissance
The field of quantum foundations experienced a long dark age due to the triumph of the Copenhagen view, but recently underwent a renaissance driven by the promise of quantum computing. Richard Feynman proposed building a new kind of computer using quantum mechanics in a 1981 lecture, followed by David Deutsch proposing a universal quantum computer in 1989, and Peter Shor proving that a quantum computer could rapidly factor large numbers. Relational quantum theory posits that quantum states represent relative information that one subsystem has about another with respect to a chosen boundary, denying the existence of a single absolute quantum state for the universe as a whole. You can understand this through Eugene Wigner's extension of Schrödinger's cat where a friend named Sarah opens the box and sees a definite live cat, while an outside observer views Sarah as being entangled in a quantum superposition.
Physicists often make the mistake of jumping directly to constitutive models rather than starting with foundational principles, which leads to dead ends and turf wars. To avoid this, you should follow a clear path from abstractions to complete systems:
- First, establish foundational principles.
- Second, formulate hypotheses that satisfy the principles.
- Third, build models to illustrate partial implications.
- Last, develop complete theories.
Fundamental physics requires five interconnected principles rooted in Leibniz's principle of sufficient reason to eliminate arbitrary background structures. You must apply these rules to keep your theoretical work grounded:
- Apply background independence so physical theories do not depend on fixed, non-evolving structures.
- Ensure space and time are relational, describing relationships between entities rather than absolute positions.
- Enforce causal completeness so every event has a cause within the universe.
- Use reciprocity so that if object A acts on object B, B must act back on A.
- Apply the identity of indiscernibles so that any two objects with identical properties are the same object.
Conclusion
You can rebuild the foundations of physics by rejecting anti-realist dogmas and pursuing realist principles that place time and relations at the center of nature.
To advance scientific progress, you must apply specific rules derived from the failure of the Copenhagen orthodoxy:
- Reject instrumentalism and demand that physical theories describe real entities existing independently of observers.
- Treat time as fundamental and real rather than an emergent or illusory byproduct of static geometry.
- Preserve background independence by ensuring that spatial and temporal relations emerge entirely from dynamical interactions.
- Support realist completions of quantum mechanics such as pilot wave theories and physical collapse models.
- Question consensus assumptions whenever foundational puzzles stall progress across your field.
10 Key Ideas
- Quantum mechanics serves as the indispensable foundation of modern physics while remaining plagued by deep conceptual paradoxes regarding the nature of reality.
- The uncertainty principle states that the more precisely you know one variable of a pair, the less precisely you can know the other, because measuring them involves non-commutative operations.
- Isolated quantum states evolve deterministically in time according to Rule 1, while measurements introduce fundamental randomness via the Born rule and cause the wave function to collapse according to Rule 2.
- Bell's theorem and definitive experiments prove that nature violates locality, revealing that quantum mechanics is inherently contextual and incomplete.
- The historical development of wave mechanics and matrix mechanics culminated in the anti-realist Copenhagen interpretation and the suppression of hidden variables.
- Pilot wave theory, physical collapse models, and relational frameworks offer realist completions of quantum mechanics that resolve paradoxes without observers.
- You can rebuild the foundations of physics by rejecting anti-realist dogmas and pursuing realist principles that place time and relations at the center of nature.
- Realists like Albert Einstein and the author maintain that science should provide a complete description of an objective external reality operating independently of human observation.
- John Bell proved mathematically that quantum mechanics violates the principle of locality, meaning that measurements on one particle can instantly affect another far away.
- David Bohm successfully formulated a realist completion of quantum mechanics in 1952 by reviving and expanding de Broglie's pilot wave theory, yielding probabilities naturally without requiring wave function collapse.