What Is Computation? Physical Limits and New Substrates

Computation, at its most fundamental level, is the transformation of information according to a set of rules. That definition sounds abstract, but it has concrete physical consequences: every computation requires energy, takes time, and happens on some physical substrate. The silicon chips in your phone are one way to compute, but not the only way. Brains, molecules of DNA, beams of light, and even oscillating chemical reactions can all process information. Understanding what computation really is, and where its limits lie, reveals why the field stretches far beyond the devices on your desk.

What Makes Something a Computation

You do not need a microprocessor to compute. Any physical process that takes an input, applies a defined transformation, and produces an output counts. A mechanical calculator from the 1800s computes. A thermostat computes, in a rudimentary way, by comparing a temperature reading against a threshold and toggling a switch. The abstraction that unites all of these is the idea that information can be encoded in a physical state, and that the laws governing the physical system can be harnessed to manipulate that information in a predictable way. The reason this matters is that the properties of the physical system doing the work set hard boundaries on how fast, how efficiently, and how reliably the computation can be done.

The Physical Limits Nobody Can Engineer Around

Because computers are physical systems, the laws of physics dictate what they can and cannot do. The speed at which a device processes information is limited by its energy, and the amount of information it can handle is limited by its physical degrees of freedom. These constraints come from constants of nature: the speed of light, the quantum scale, and the gravitational constant.1PubMed. Ultimate physical limits to computation No cleverness in chip design can violate these boundaries. They represent the absolute ceiling on computational performance for any machine operating under our universe’s rules.

At the other end of the scale, thermodynamics sets a floor on energy consumption. Erasing a single bit of information has a minimum energy cost, a result known as Landauer’s principle. That minimum is only reached under idealized conditions with infinitely long operation time; any real-world device operating at finite speed pays more.2PubMed. Minimal energy cost to initialize a bit with tolerable error This is not an engineering limitation waiting to be solved. It is baked into the relationship between information and entropy. Every time your computer clears a register or overwrites a memory cell, it dissipates at least that much energy as heat. The practical implication: as transistors shrink and clock speeds rise, the heat generated per unit area climbs, and the thermodynamic floor becomes an increasingly relevant constraint on how dense and fast we can make conventional processors.

Why Conventional Chips Hit a Wall

Most computers today follow the general architecture laid down decades ago, in which a processor fetches data from memory, operates on it, and writes results back. This separation of computation and storage creates a bottleneck. Data has to shuttle back and forth between the memory and the processor along shared pathways, and that traffic becomes the limiting factor, especially for applications that need to crunch enormous datasets. This constraint, sometimes called the memory wall, means that even if the processor itself could run faster, it spends much of its time waiting for data to arrive.3Science China Information Sciences. Breaking the von Neumann bottleneck: architecture-level processing-in-memory technology

The explosion of machine learning and other data-heavy workloads has made this bottleneck more painful than ever. Training a large neural network involves billions of simple arithmetic operations on massive arrays of numbers, and the processor spends far more energy moving those numbers around than actually computing with them. This mismatch has driven a wave of interest in architectures that compute where the data already lives, rather than moving data to a centralized processor.

How Brains Compute Differently

The human brain offers a striking counterexample to conventional chip design. It runs on roughly 20 watts of power, comparable to a dim light bulb, yet handles pattern recognition, language, and motor control that still challenge warehouses full of GPUs. Part of the explanation is architectural: neurons process information right where it is stored, in the synaptic connections between cells. There is no separation of memory and processor. Another part is that evolution has had a long time to optimize for energy efficiency. In the cortex, communication between neurons consumes about 35 times more energy than the local computation each neuron performs, but both costs appear to be tuned to produce the observed density of synapses as efficiently as possible.4PubMed Central. Communication consumes 35 times more energy than computation in the human cortex, but both costs are needed to predict synapse number

Even the fact that mammals are warm-blooded plays a role. Generating an electrical impulse along a nerve fiber turns out to be substantially more energy-efficient in warm tissue than in cold tissue. Higher temperatures speed up the inactivation of ion channels, which reduces wasteful overlap between competing ionic currents and shortens the duration of each impulse.5PLoS Computational Biology. Warm Body Temperature Facilitates Energy Efficient Cortical Action Potentials In other words, being warm-blooded is not just about metabolism; it is a computational advantage. This kind of deep integration between the physical substrate and the computation it performs is something that engineered systems are only beginning to imitate.

Computing with DNA, Chemicals, and Light

If computation is really just rule-governed transformation of physical states, then there is no reason silicon has to be the material doing the work. Researchers have demonstrated this point vividly with unconventional substrates. In a landmark experiment, the tools of molecular biology were used to solve a graph theory problem by encoding the problem in strands of DNA. The “operations” of the computation were performed with standard laboratory enzymes and protocols, demonstrating that computation at the molecular level is feasible.6PubMed. Molecular computation of solutions to combinatorial problems DNA computing exploits the massive parallelism of chemistry: trillions of molecules can react simultaneously, searching an enormous solution space in one go. The trade-off is that reading out the answer is slow and error-prone by electronic standards, which has kept DNA computing in the research lab rather than on your desk.

Chemical reactions offer another route. A programmable processor built from a grid of cells filled with an oscillating chemical reaction demonstrated addressable memory and basic pattern recognition, performing the equivalent of about a million operations per second by detecting distinct amplitudes of oscillation through image processing.7Nature Communications. A programmable chemical computer with memory and pattern recognition A million operations per second sounds laughably slow compared to a modern CPU. But the point is not raw speed; it is proof that computation can emerge from chemical dynamics, which opens up possibilities for environments or scales where electronics cannot easily go, such as inside living tissue or in soft robotic systems.

Light is a more immediately competitive alternative. Photonic processors encode information in beams of light rather than flows of electrons, and because light can carry multiple signals simultaneously without interference, photonic chips can perform certain mathematical operations extremely fast and with low energy. A recently demonstrated chip-scale photonic processor performed complex-valued matrix-vector multiplication at a speed of 1.28 tera-operations per second.8PubMed Central. Complex-valued matrix-vector multiplication using a scalable coherent photonic processor Matrix-vector multiplication is the workhorse operation behind neural networks and many scientific simulations, so a photonic chip that does it well could serve as a co-processor alongside conventional electronics, handling the most data-intensive steps at a fraction of the energy cost.

Neuromorphic Hardware and the Return of Analog

Inspired by the brain’s architecture, neuromorphic computing tries to merge storage and processing in a single physical device. One of the most promising building blocks is the memristor, a resistive device whose resistance changes depending on the history of current that has flowed through it and stays put when the power is off. That memory-like behavior lets a memristor serve simultaneously as a computational unit and a data store. Arranged in crossbar arrays, memristors can perform matrix-vector multiplication directly in the hardware, without shuttling data back and forth, and can also mimic synaptic behavior for spike-based learning algorithms.9Advanced Intelligent Systems. Review of Memristors for In‐Memory Computing and Spiking Neural Networks

This approach is not just theoretical. Researchers have built fully analog memristor arrays that solve continuous-time differential equations, modeling complex dynamical systems the way an analog computer from the 1960s might have, but on a chip small enough to embed in an edge device. Because the computation happens entirely within the memory array, the system sidesteps the conventional bottleneck and reduces the need for analog-to-digital conversion, which is itself an energy-hungry step.10PubMed Central. Continuous-time digital twin with analog memristive neural ordinary differential equation solver The practical appeal is large for applications like real-time sensor processing, autonomous vehicles, and wearable medical devices, all of which need to make quick decisions from streaming data on a tight energy budget.

Quantum Computation

Quantum computers replace classical bits with quantum bits, or qubits, which can exist in superpositions of states and become entangled with one another. These properties allow quantum machines to explore many possible solutions simultaneously, offering a potential speed advantage over classical computers for specific classes of problems like factoring large numbers, simulating molecular behavior, and optimizing complex systems.11Journal of Industrial Information Integration. Quantum computing and industrial information integration: A review

The central engineering challenge is error. Qubits are extremely sensitive to their environment, and even tiny disturbances cause errors to accumulate, a process called decoherence. Quantum error correction addresses this by distributing information across many entangled physical qubits to protect against individual errors.12Nature. Quantum error correction below the surface code threshold The difficulty is that adding more physical qubits for error correction adds more physical hardware that itself can fail. Recent progress has pushed error rates below key thresholds that had been considered necessary for practical quantum computing, but the technology remains in an early stage. Current quantum machines can outperform classical computers only on carefully chosen demonstration problems, not on general-purpose tasks. Whether quantum computing will become broadly useful or remain a specialized tool for narrow problem types is one of the genuinely open questions in the field.

Protecting quantum information against decoherence remains the central preoccupation of the field, driving research into better error-correcting codes, more stable qubit designs, and hybrid architectures that pair a small quantum processor with a classical control system.13Quantum Science and Technology. Learning encodings by maximizing state distinguishability: variational quantum error correction For now, the honest assessment is that quantum computing is a bet on future engineering rather than a technology you can deploy today for everyday tasks.

Reservoir Computing and Probabilistic Machines

Not every computing paradigm tries to control every internal state precisely. Reservoir computing takes the opposite approach: it feeds input signals into a complex physical system, lets the system’s natural dynamics transform the data, and then trains only a simple output layer to read off the result. The “reservoir” itself is never updated or optimized. This makes it remarkably easy to implement in hardware, because almost any physical system with rich, nonlinear dynamics can serve as the reservoir.14PubMed. Recent advances in physical reservoir computing: A review Researchers have built reservoirs from buckets of water, networks of electronic oscillators, and even patterns of magnetic domains in thin films, where the natural behavior of magnetization under input signals provides the temporal data processing.15PubMed Central. Harnessing spatiotemporal transformation in magnetic domains for nonvolatile physical reservoir computing

The appeal is twofold. First, because you do not need to train the reservoir, building one is far simpler than fabricating a full neural network in hardware. Second, the reservoir exploits the physics of the substrate rather than fighting it. Random variations, nonlinearities, and even noise become computational resources instead of defects to be eliminated. The limitation is that reservoir computing is best suited for time-series tasks like speech recognition and sensor signal classification, rather than the kind of general-purpose logic a conventional CPU handles.

Pushing even further into the embrace of randomness, probabilistic computing uses stochastic hardware elements whose output fluctuates randomly but with a tunable bias. These probabilistic bits, or p-bits, exploit rather than suppress thermal fluctuations, offering a route to energy-efficient computation for optimization and sampling tasks.16arXiv. Polymer-based probabilistic bits for thermodynamic computing Where a classical bit must be firmly 0 or 1 and a qubit exists in a delicate quantum superposition, a p-bit is simply noisy on purpose. The engineering requirements are far less demanding than for qubits, because p-bits operate at room temperature and do not need extreme isolation from the environment. Early prototypes have been built using magnetic tunnel junctions and, more recently, polymer-based devices, suggesting that the hardware could eventually be cheap and scalable.

When Many Machines Compute Together

Computation does not have to happen on a single device. Distributed systems spread a task across many networked machines, which introduces a new kind of problem: how do you get all the machines to agree on a result when some of them might fail or behave unpredictably? Fault-tolerant consensus protocols solve this by ensuring that nodes collectively agree on a consistent value even when some components are faulty or compromised.17High-Confidence Computing. A survey of fault tolerant consensus in wireless networks

This might sound like an abstract concern, but it underpins everything from cloud computing to blockchain networks to the coordination of autonomous vehicle fleets. The challenge intensifies in wireless networks, where communication is unreliable and messages can be lost or delayed. Decades of research have produced a family of consensus algorithms that trade off between speed, fault tolerance, and communication overhead, and the choice of algorithm has real consequences for how responsive and reliable a distributed system feels to the end user. If you have ever noticed a cloud service briefly showing stale data before snapping to the correct value, you have witnessed the latency cost of distributed consensus in action.

Why the Substrate Matters More Than Ever

For most of computing history, progress meant making silicon transistors smaller and faster. That approach worked spectacularly well for decades, but it is running into physical walls on multiple fronts: thermodynamic limits on how little energy each operation can consume, the memory bottleneck that starves fast processors of data, and the approaching atomic scale beyond which transistors cannot reliably shrink. The response has not been to abandon silicon but to diversify. Photonic accelerators for matrix math, memristive arrays for in-memory neural networks, physical reservoirs for time-series classification, and quantum processors for molecular simulation each exploit a different set of physical properties to do a different kind of work well.

The likely future is not a single dominant computing substrate replacing silicon but a heterogeneous stack in which different physical systems handle different parts of a workload. Your phone’s main processor might remain silicon, but a photonic co-processor could handle the heavy linear algebra behind image recognition, while a small neuromorphic chip manages always-on sensor fusion at a fraction of the power. Quantum processors, if they mature, would live in the cloud and be called on for specific hard problems. In this picture, understanding computation means understanding not just algorithms but the physics of the materials that execute them, because the choice of substrate increasingly determines what is practical and what is not.