Extended reality is the umbrella term for technologies that blend physical and digital environments or create entirely synthetic ones, spanning virtual reality (VR), augmented reality (AR), and mixed reality (MR). What makes the term useful is that the boundaries between those three categories keep blurring as hardware evolves; a single headset today might switch between fully immersive VR and see-through AR depending on the app. The technology touches everything from surgical training and PTSD therapy to factory assembly lines and social platforms, and the research behind it has grown rapidly enough that it is worth understanding both what XR can do well and where it still trips up.
What Counts as Extended Reality
VR replaces your entire visual field with a computer-generated scene, typically through a headset with opaque lenses. AR overlays digital content onto the real world, whether through transparent glasses, a phone camera, or a heads-up display. MR sits between the two, letting virtual objects interact with physical surfaces so that a digital ball can roll off your real desk and bounce on your real floor. “Extended reality” (XR) simply wraps all three into one phrase, which is useful because modern headsets increasingly slide along this spectrum rather than camping at one end.
The core components are similar across the spectrum. You need a display close to the eyes, sensors that track head and body movement, processors fast enough to update the scene before the user notices lag, and increasingly, eye tracking and hand tracking built into the hardware. The details of how each piece works have significant consequences for comfort, realism, and the kinds of side effects users experience.
The Display Problem Your Eyes Cannot Ignore
One of the oldest unsolved challenges in XR is the vergence-accommodation conflict. In the real world, when you look at a nearby object, your eyes both angle inward (vergence) and adjust their lens shape (accommodation) to the same distance. In a headset, the screen sits at a fixed physical distance from your eyes, so your lenses always focus at that distance. But the stereoscopic images trick your eyes into angling toward virtual objects at many different apparent depths. The result is a mismatch: your brain gets told two contradictory things about how far away something is.1Results in Optics. Vergence-accommodation conflict in optical see-through display: review and prospect
Research has found that short sessions of around 30 minutes do not necessarily cause lasting changes to the eye’s focusing system, though users still report increased symptoms like eyestrain and general discomfort after even brief sessions.2PubMed Central. Effect of a vergence-accommodation conflict induced during a 30-minute Virtual Reality game on vergence-accommodation parameters and related symptoms The discomfort tends to be worse when the virtual object appears much closer or farther than the screen actually is. Hardware companies are experimenting with varifocal lenses and light-field displays that could fix the conflict entirely, but those solutions are not yet in mainstream consumer devices.
Why XR Makes Some People Sick
Cybersickness, sometimes called simulator sickness, is probably the most common complaint among XR users. It feels similar to motion sickness: nausea, dizziness, sweating, sometimes a lingering sense of unease. The leading explanation is sensory conflict, where what your eyes report does not match what your inner ear (vestibular system) expects.3PubMed Central. Sensory conflict in simulator sessions – measuring biosignals to predict the onset of disorderly symptoms: a brief literature review If your headset shows you flying through a canyon but your body is sitting on a couch, the mismatch can trigger nausea in minutes.
Researchers have tested a creative countermeasure: galvanic vestibular stimulation (GVS), which sends a small electrical current to the skin behind the ears to nudge the vestibular system. In one experiment, adjusting the GVS signal to reduce the sensory mismatch lowered motion sickness symptoms, while deliberately increasing the conflict made symptoms worse, confirming that the vestibular mismatch is genuinely driving the problem.4Communications Engineering. Validating sensory conflict theory and mitigating motion sickness in humans with galvanic vestibular stimulation Practical GVS devices for consumers are still a long way off, so for now the main remedies are design-level choices: reducing virtual locomotion speed, adding a fixed visual reference frame, and keeping sessions short.
What Happens to Your Balance After You Take the Headset Off
Even after a VR session ends, users can feel physically off-kilter. Studies measuring postural sway have found that standing stability after VR exposure is worse than normal, comparable to standing with your eyes closed.5PubMed Central. Effects of virtual reality immersion on postural stability during a dynamic transition task Your body relies on vision, inner-ear signals, and joint sensors to keep you upright, and a VR session can temporarily scramble the weighting your brain gives each channel.
One explanation is that during VR, the brain downweights visual input for balance (since the visuals no longer match real body motion) and leans more on proprioceptive cues from muscles and joints. When the headset comes off, the brain does not instantly switch back. The leftover reliance on the less efficient channel means more wobble and higher energy expenditure to stay balanced.6Scientific Reports. Postural instability in an immersive Virtual Reality adapts with repetition and includes directional and gender specific effects The effect fades, and repeated VR use seems to reduce it, but it is worth knowing about if you plan to do anything physically demanding immediately after a long session.
How Rendering Keeps Up with Your Eyes
Generating a full-resolution 3D scene at 90 frames per second (the typical target for comfortable VR) is computationally expensive. Foveated rendering is one of the most promising solutions. It takes advantage of the fact that your sharpest vision covers only a few degrees of your visual field at any moment. By tracking where your eyes are pointed, the system renders that small region in full detail and drops the resolution everywhere else.7PubMed Central. A Quality-Centered Analysis of Eye Tracking Data in Foveated Rendering
The savings can be dramatic. Individualized foveated rendering, which calibrates the dropoff profile to each user’s actual visual acuity rather than using a one-size-fits-all curve, has shown measurable gains in computational efficiency. Some users need a more conservative falloff than others (their peripheral vision catches low-resolution artifacts more easily), so the system adjusts per person.8Virtual Reality. Individualized foveated rendering with eye-tracking head-mounted display The technique is already shipping in several consumer headsets, and it is one of the main reasons standalone, battery-powered headsets can deliver visuals that once required a wired connection to a desktop gaming PC.
Sound, Touch, and the Multisensory Picture
Visuals get most of the attention in XR discussions, but the other senses matter more than many people expect. Spatial audio, the kind that makes you instinctively turn toward a sound source, depends on personalizing what are called head-related transfer functions. These are mathematical descriptions of how sound waves bend around your specific head, ears, and torso before reaching your eardrums. Generic profiles work reasonably well, but personalized ones make virtual sound sources feel significantly more “placed” in the real world.9The Journal of the Acoustical Society of America. Head-related transfer function personalization for the needs of spatial audio in mixed and virtual reality
Touch is harder. Haptic feedback in current consumer controllers is mostly limited to vibration motors, but research into richer haptics shows that combining vibration with matching audio and visual cues changes how people perceive surfaces. In one study, when vibrotactile, auditory, and visual roughness cues were presented together, each sensory channel modulated how rough a virtual surface felt, and the combined effect was not a simple addition but a genuine integration of all three signals.10bioRxiv. Perceptual integration of multisensory haptic, visual, and auditory feedback for roughness discrimination in augmented reality In medical imaging, participants exploring 3D datasets with hand tracking and multisensory feedback reported that the experience felt more intuitive and offered better depth understanding than traditional screen-based tools.11PubMed Central. Multisensory Extended Reality Applications Offer Benefits for Volumetric Biomedical Image Analysis in Research and Medicine
Treating PTSD and Phobias
One of the most studied clinical applications of XR is virtual reality exposure therapy (VRET) for post-traumatic stress disorder. The idea is familiar from conventional exposure therapy: gradually confronting the feared memory or situation in a controlled setting so the emotional response diminishes over time. VR lets therapists create specific trauma-related scenes, from combat environments to car accidents, that would be impossible or unethical to recreate physically.
Meta-analyses comparing VRET to waitlist controls have found meaningful reductions in PTSD symptoms. One found a moderate effect favoring VRET for both PTSD symptoms and depressive symptoms compared with no treatment, but no significant difference when VRET was compared to other active treatments like traditional in-person exposure therapy.12PubMed Central. Virtual reality exposure therapy for posttraumatic stress disorder (PTSD): a meta-analysis A separate meta-analysis found that graded exposure therapy in VR showed a large effect on PTSD symptoms compared with controls, suggesting that how the exposure is structured (gradually increasing intensity) may matter as much as the technology itself.13PubMed Central. Effects of Virtual Reality-Based Graded Exposure Therapy on PTSD Symptoms: A Systematic Review and Meta-Analysis
The practical advantage is that VRET can reach patients who find traditional imaginal exposure too difficult. When someone struggles to conjure and hold a trauma memory voluntarily, the immersive visuals and sounds help activate the traumatic memory enough for therapeutic extinction to occur.14PLoS ONE. Efficacy of Virtual Reality Exposure Therapy in the Treatment of PTSD: A Systematic Review For specific phobias like fear of heights or spiders, VRET has been considered effective for longer, and PTSD treatment is catching up.
XR for Pain and Physical Rehabilitation
Hospitals and burn centers have used VR distraction for pain management since the early 2000s. The hypothesis is straightforward: immersion competes for the brain’s attentional resources, leaving less capacity to process pain signals.15PubMed Central. Virtual reality and pain management: current trends and future directions More recent work using electroencephalography has pinpointed some of the neural mechanisms. In one study, VR exploration scenes lowered both pain intensity and unpleasantness from heat stimuli, and the pain reduction correlated with changes in specific brainwave patterns, including decreased cortical responses to the painful stimulus and increased pre-stimulus gamma oscillations associated with immersive engagement.16PubMed. The analgesic effects and neural oscillatory mechanisms of virtual reality scenes based on distraction and mindfulness strategies in human volunteers Interestingly, a VR mindfulness meditation scene worked through a different neural pathway (boosting alpha oscillations rather than gamma) but achieved comparable pain relief, suggesting that VR can deliver pain reduction through more than one mechanism.
In stroke rehabilitation, VR-based hand therapy has shown promise. One study had chronic stroke patients use a sensor glove at home for unsupervised exercises, and they improved on a standard hand function test during the intervention period.17PubMed. Home-based virtual reality therapy for hand recovery after stroke An earlier trial using a haptic glove for intensive VR hand exercises over three weeks found gains in finger range of motion, speed, and coordination, with two patients retaining the improvements a month later and showing faster performance on real-world tasks like picking up objects.18PubMed. Virtual reality-based post-stroke hand rehabilitation The appeal for rehabilitation is that VR can make repetitive exercises more engaging, which is critical for a recovery process that demands hundreds of movement repetitions per session.
Surgical and Procedural Training
Training surgeons on VR simulators before they operate on real patients is one of the clearest success stories in the field. In a landmark randomized study, surgical residents who trained on a VR laparoscopic simulator before performing a gallbladder removal in the operating room completed the dissection about 29% faster than their peers who did not receive VR training. The untrained group was nine times more likely to stall during the procedure and five times more likely to injure the gallbladder or burn surrounding tissue.19PubMed Central. Virtual Reality Training Improves Operating Room Performance Results of a Randomized, Double-Blinded Study The skills genuinely transferred from the simulated environment to a live patient.
This principle extends beyond surgeons. Scrub nurses trained in immersive VR on the steps for complex knee replacement surgery demonstrated real-world skill transfer, handling instruments and assisting more effectively than they could before the training.20PubMed Central. Immersive virtual reality enables technical skill acquisition for scrub nurses in complex revision total knee arthroplasty For industrial applications, AR assembly guidance has shown similar benefits. In one test of a smart AR instructional system for assembling a CNC carving machine, workers using the system finished about a third faster and made roughly a third fewer errors compared with conventional instructions.21Journal of Manufacturing Systems. Smart augmented reality instructional system for mechanical assembly towards worker-centered intelligent manufacturing
The Cognitive Load Trade-Off
If XR is so immersive, you might assume it is always better for learning. The evidence is more complicated. Immersive VR tends to increase cognitive load compared with learning on a conventional screen, and that extra mental burden can actually hurt retention. In a visuomotor adaptation study, participants learning a task in a headset showed higher cognitive load and poorer long-term retention and transfer to new contexts than those who learned the same task on a flat screen.22PubMed Central. Increased cognitive load in immersive virtual reality during visuomotor adaptation is associated with decreased long-term retention and context transfer
A multi-day field study of immersive VR training echoed those findings: the VR groups showed higher cognitive load, lower learning outcomes, and lower self-efficacy scores compared with a control group using conventional methods.23Computers in Human Behavior. Immersive virtual reality learning and cognitive load: A multiple-day field study The takeaway is not that VR is bad for education, but that immersion is not automatically helpful. VR works best for training that specifically benefits from spatial understanding, embodied practice, or exposure to dangerous environments. For tasks that are primarily conceptual or text-heavy, the extra sensory information may be a distraction rather than an advantage.
Avatar Embodiment and the Proteus Effect
When you inhabit an avatar in VR, something unexpected happens: your behavior shifts to match the avatar’s appearance. Researchers call this the Proteus effect. Users given taller avatars negotiate more aggressively in virtual exchanges. Users given avatars that look older allocate more money to retirement savings. The effect is not limited to positive outcomes.24PubMed Central. A theoretical review of the Proteus effect: understanding the underlying processes
In one study, participants who wore sexualized avatars reported more body-related thoughts, a sign of self-objectification, than those in non-sexualized avatars. More troublingly, participants who saw their own faces mapped onto sexualized avatars expressed greater acceptance of rape myths than those in other conditions.25Computers in Human Behavior. The embodiment of sexualized virtual selves: The Proteus effect and experiences of self-objectification via avatars These findings raise genuine questions about how social VR platforms handle avatar design, especially for younger users who may be more susceptible to internalizing avatar-linked attitudes.
Social Presence in Shared Virtual Spaces
XR is increasingly social. Platforms for shared virtual workspaces, concerts, and casual hangouts have grown rapidly, and the research question is whether people interact naturally when both parties are represented by digital bodies. One study measured nonverbal synchrony, the unconscious mirroring of movement between interaction partners, in VR. Pairs collaborating on a task showed genuine synchrony in their head movements and hand gestures, distinct from what random pairing would produce.26PLoS ONE. Nonverbal synchrony in virtual reality The effect was clearer in cooperative than competitive settings, which matches what you would expect from in-person interaction research. This suggests that at least some of the social glue that holds face-to-face conversations together does carry over into avatar-mediated ones.
Neuroscience has also confirmed that the subjective feeling of “being there” in a virtual world, known as presence, is a real neural phenomenon, not just self-report bias. One of the first fMRI studies of VR presence found that participants could experience strong presence even inside the constrained, noisy environment of a brain scanner, and that the brain regions activated during presence overlapped with those involved in spatial navigation and emotional processing.27PubMed. The illusion of presence in immersive virtual reality during an fMRI brain scan
Privacy and Biometric Data Risks
Every sensor that makes XR work also collects data about your body. Eye tracking reveals not just where you look but pupil dilation, blink rate, and gaze patterns that can be linked to emotional state, cognitive load, or even neurological conditions. Hand tracking captures fine motor behavior. Inside-out cameras map your physical environment. The biometric data flowing through an XR session is vastly richer than what a smartphone collects, and much of it is gathered by third-party apps, not just the headset manufacturer.28SSRN. Privacy and Security in Extended Reality: Exploring the Risks of External Biometric Data Collection
Regulatory frameworks are catching up slowly. Existing biometric privacy laws like the EU’s GDPR and Illinois’s BIPA were not written with XR in mind, and there are open questions about whether eye-tracking data qualifies as biometric under statutes that were drafted around fingerprints and facial recognition. Users have limited visibility into what data leaves the device and where it goes, which is a problem when the data is uniquely personal and difficult to change. You can get a new password, but you cannot get new iris patterns.
Where XR Meets Brain-Computer Interfaces
A newer frontier is combining XR headsets with brain-computer interfaces (BCIs) that read electrical signals from the scalp. The idea is to let users interact with virtual objects through thought alone, which could be transformative for people with severe motor disabilities. One recent study integrated a mixed reality headset with a BCI driven by visual evoked potentials, signals the brain produces in response to flickering visual stimuli, and achieved roughly 97% accuracy at about 28 bits per minute of information transfer. That performance was essentially equal to a conventional flat-screen BCI setup, and users reported similarly low visual fatigue in both conditions.29Biocybernetics and Biomedical Engineering. Toward the integration of mixed reality and brain-computer interfaces based on code-modulated visual evoked potentials The fact that MR did not degrade BCI performance is encouraging: it means the spatial freedom and richer visual environment of a headset do not come at a cost to the brain signals the interface relies on.
Anchoring Digital Objects to the Real World
For augmented and mixed reality to work outdoors, the system needs to know exactly where you are and what direction you are facing, down to centimeter-level accuracy. GPS alone is not precise enough. One approach combines visual simultaneous localization and mapping (VSLAM), which builds a 3D map of your surroundings from the camera feed in real time, with cloud-based databases of street-level imagery to correct for drift.30PubMed Central. An Enhancement of Outdoor Location-Based Augmented Reality Anchor Precision through VSLAM and Google Street View Without this kind of spatial anchoring, virtual signs would float away from storefronts and navigation arrows would point at the wrong street. The technology is steadily improving, but outdoor AR in unfamiliar environments with changing lighting conditions remains harder than indoor use, where the surroundings are more controlled.
Accessibility Gaps That Still Need Closing
Most XR hardware is designed around a fairly narrow range of bodies: two working hands, the ability to stand and move, typical vision and hearing. Some accommodations already exist, like seated play modes and live captioning of speech, but they were not the starting point of the design process. Users with low vision face particular challenges because the interface assumes a high-resolution foveal region that not everyone has. Users who are deaf or hard of hearing lose much of the spatial audio dimension that contributes to immersion. And users with motor impairments may struggle with controllers that assume a firm grip and multiple-finger dexterity.
Researchers have started framing accessibility in XR as spanning three layers: hardware access (can you physically wear and operate the device), embodied access (does the system accommodate your specific body and senses), and spatial access (can you use the experiences in the physical spaces available to you, whether that is a large room or a wheelchair). Thinking about all three layers simultaneously rather than bolting on accommodations after the fact is where the field is slowly heading, though consumer products still have a long way to go.