Memory begins far earlier than most people realize. The brain starts recording and responding to sensory information during the third trimester of pregnancy, around 28 to 30 weeks of gestation. But the kind of memory most people mean when they ask this question, the ability to form lasting personal memories you can recall years later, doesn’t reliably appear until around age 3 to 4. The gap between those two milestones reflects a long, layered process in which different memory systems come online at different times.
Memory Before Birth
The inner ear becomes functional at roughly 24 to 26 weeks of gestation, and by 28 to 30 weeks, the nerve connections linking the ear to the brain’s cortex are established well enough to start processing sound. At this stage, the brain’s responses to sound are slow and faint, but they’re real. By 35 weeks, fetuses can detect patterns in sequences of syllables, a basic form of learning that requires holding information in memory even briefly.
Smell and taste offer even stronger evidence of prenatal memory. The fetus is surrounded by amniotic fluid that carries chemical traces of the mother’s diet. When pregnant women regularly eat strongly flavored foods like garlic, carrots, or certain cheeses, their newborns show preferences for those same flavors after birth, sometimes lasting months or even years. Newborns also prefer the smell of their own amniotic fluid over someone else’s, and they respond to specific odors they encountered in the womb. In one study, babies exposed to an odorant for just 30 minutes after birth could recognize it two to three days later.
What Newborns Remember
Within hours of birth, a newborn placed on the mother’s chest will crawl toward the breast, guided partly by smell. By day two, babies begin distinguishing their mother’s breast odor from another woman’s, and by six days that preference is firmly established. Bottle-fed newborns who have never nursed still turn toward the scent of an unfamiliar lactating woman’s breast over the smell of their formula, suggesting something deeper than simple familiarity is at work.
These early abilities rely on what researchers call implicit or procedural memory. It’s the kind of memory that operates automatically, without conscious awareness. A newborn doesn’t “decide” to prefer its mother’s scent any more than you decide to flinch when something flies at your face. This system is functional from birth and drives much of what infants learn in their first months: which sounds are familiar, which smells signal food, which movements produce interesting results.
How Infant Memory Grows
For decades, the dominant view in developmental psychology, shaped heavily by Piaget, was that infants under 18 to 24 months were limited to sensory-motor habits. They could learn routines and reactions but couldn’t mentally represent something that wasn’t right in front of them. That view has been significantly revised. Studies now show that babies as young as 9 months can watch someone perform a novel action and reproduce it a full 24 hours later, a skill called deferred imitation. By 14 months, this ability is robust. Reproducing an action from memory after a delay requires holding a mental representation of something no longer visible, which is a form of declarative memory, the system responsible for conscious recall of events and facts.
The hippocampus, the brain structure most critical for forming new declarative memories, undergoes its most dramatic growth in the first two years of life. MRI studies show hippocampal volume increases most rapidly between 1 and 2 months of age, continues growing quickly through age 2, then slows but keeps developing through adolescence, peaking in volume around ages 9 to 11. This prolonged development means the memory hardware is being built and refined for years.
Why You Can’t Remember Being a Baby
If babies can form memories at 9 months, why can’t anyone remember being an infant? This is the puzzle of infantile amnesia. Among adults, the average earliest memory dates to about age 3 to 4. Children tested between ages 7 and 11 report earliest memories from around 3 years and 8 months, a strikingly consistent number. The density of retrievable memories increases gradually from about age 3½ to 7, at which point the distribution starts to resemble what you’d see in an adult.
One compelling explanation involves the hippocampus itself. During infancy, the hippocampus produces new neurons at an extremely high rate. This neurogenesis is essential for brain development, but it comes with a cost: as new neurons integrate into existing circuits, they likely overwrite or disrupt the synaptic connections that stored earlier memories. In effect, the very process that builds the memory system also erases what was previously recorded. This pattern holds across species. Human infants, young primates, and infant rodents all show both high hippocampal neurogenesis and an inability to retain memories long-term.
Language also plays a role in the transition to lasting memory. Before children have words to label and organize their experiences, encoding those experiences in a way that can be retrieved years later is difficult. The emergence of autobiographical memory, the running narrative of “things that happened to me,” tracks closely with language development. Acting something out or connecting it to a personal experience produces stronger memory traces than simply hearing words, but without any verbal framework at all, the scaffolding for long-term personal narrative barely exists.
The Timeline at a Glance
- 24 to 30 weeks gestation: The auditory system comes online and the fetus begins processing sounds, rhythms, and flavors from the mother’s diet.
- Birth: Implicit memory is functional. Newborns recognize their mother’s scent, prefer familiar amniotic fluid odors, and respond to flavors encountered in the womb.
- 6 to 9 months: Babies begin showing evidence of declarative memory, imitating actions after delays of a day or more.
- 14 to 18 months: Deferred imitation becomes strong and reliable, signaling a maturing ability to store and retrieve specific events.
- 2 to 3 years: The hippocampus has completed its most rapid growth phase. Autobiographical memories begin forming that some children will retain into later childhood.
- 3½ to 7 years: Lasting personal memories accumulate, and the rate of forgetting early events slows to near-adult levels by age 7.
What “Memory” Really Means Here
The answer to “when does memory start” depends entirely on what kind of memory you’re asking about. If you mean the brain’s ability to record and respond to experience, it starts before birth. A fetus at 30 weeks is already learning. If you mean the ability to consciously recall a specific event after a delay, that emerges gradually over the first year of life and strengthens dramatically through the toddler years. And if you mean the kind of memories that stick for a lifetime, those typically begin forming around age 3 to 4, after the hippocampus has matured enough and neurogenesis has slowed enough for memory circuits to stabilize.
The brain doesn’t flip a switch from “no memory” to “memory.” It builds the capacity in stages, each dependent on biological development that unfolds over years. Even at age 7, the system is still maturing. The hippocampus continues refining its structure into adolescence, and the full effects of early brain development on memory and learning may not become apparent until much later.