Augmented reality in healthcare is technology that overlays digital images, data, or 3D models onto a clinician’s or patient’s view of the real world. Unlike virtual reality, which replaces your surroundings entirely, AR adds information on top of what you’re already seeing, typically through a headset, smart glasses, or even a smartphone screen. The U.S. market for AR and VR in healthcare was valued at $1.03 billion in 2024 and is projected to more than double to $2.34 billion by 2030, reflecting how quickly hospitals and medical schools are adopting these tools.
How AR Works in a Clinical Setting
An AR system combines cameras, sensors, and software to detect the real environment and then project digital content into the user’s field of view. In an operating room, for example, a surgeon wearing a head-mounted display can see a patient’s CT scan or MRI data superimposed directly onto the body during a procedure. The digital layer moves and adjusts as the surgeon shifts position, keeping the overlay aligned with the patient’s actual anatomy. The FDA categorizes these systems as medical devices and defines AR as “overlaying or mixing simulated digital imagery with the real world as seen through a camera or display.”
The hardware ranges from lightweight smart glasses to full headsets like the Microsoft HoloLens. Some applications don’t require a headset at all. Tablet and smartphone-based AR lets medical students rotate a 3D heart model on a device they already own, making the technology accessible without expensive equipment.
Guiding Surgeons in the Operating Room
Surgery is where AR has made some of its most measurable impacts. Spinal surgery offers a clear example: placing screws into vertebrae has traditionally relied on a surgeon’s anatomical knowledge and feel. AR surgical navigation systems project the ideal screw path directly onto the surgeon’s view, and the accuracy gains are significant. In cadaveric studies of the XVision AR headset for spinal screw placement, accuracy rates ranged from 96.7% to 99.1%, compared to 64% accuracy with the traditional freehand technique.
Speed improves too. Surgeons using AR-assisted guidance during spine instrumentation reduced operative time to about 4.1 minutes per screw, down from a baseline of nearly 4.9 minutes. That may sound modest for a single screw, but spine surgeries often involve dozens of screws, so the cumulative time savings reduce how long patients spend under anesthesia. Studies using the HoloLens to map screw locations also found a 20% reduction in the time spent bending and inserting connecting rods, while simultaneously improving the accuracy of that step.
Training the Next Generation of Clinicians
Medical education has long relied on cadavers, textbooks, and flat anatomical diagrams. AR adds a spatial dimension that’s difficult to replicate on paper. Students can explore a 3D nervous system, watch simulated nerve impulses travel through the brain, or practice a procedure on a virtual patient layered over a physical mannequin. Studies comparing AR-trained medical students to those using conventional methods found that the AR group achieved higher learning scores and made fewer procedural errors.
Student preference is telling as well. In one study of 49 participants across varying levels of clinical experience, 67% preferred AR-based training over textbook methods. Because many AR applications run on smartphones or tablets, students can practice at their own pace outside the classroom without the motion sickness that sometimes accompanies full virtual reality headsets.
Helping Patients Understand Their Own Care
One of the less obvious but potentially powerful uses of AR is in patient education and informed consent. Explaining a complex surgery using flat X-rays or verbal descriptions often leaves patients with an incomplete picture. AR tools let a patient see a 3D model of their own anatomy, view exactly where an incision will be made, and understand what a procedure involves in a way that two-dimensional images can’t convey.
A systematic review published in PLOS Digital Health found that patients in nearly every study preferred AR-enhanced consent and education programs over standard resources. Understanding of their disease and proposed treatments improved, and patients reported that AR materials required less mental effort to process than traditional written literature. The benefit appears greatest for complex procedures or situations where patients face difficult decisions between treatment options. For children in particular, interactive 3D visuals may improve engagement and help them retain more information about what to expect.
Remote Guidance for Underserved Areas
AR is also changing what’s possible in remote and rural healthcare. Through a process called telestration, a specialist in one city can see exactly what a surgeon in another location sees in real time, then draw annotations, arrows, or virtual hand gestures directly onto the operative field. The local surgeon sees these visual cues overlaid on their view of the patient, along with verbal instructions, allowing the remote expert to guide each step of a procedure without being physically present.
A study conducted across Japan tested teleproctoring for minimally invasive surgery using ultra-low-latency communication systems. The researchers concluded that this approach offers a sustainable model for surgical education and care delivery, particularly in rural areas and countries with limited medical infrastructure. The practical implication is significant: a surgeon in a small community hospital can receive real-time expert guidance that previously would have required transferring the patient to a larger facility, reducing delays and expanding access to specialized care.
Physical Therapy and Rehabilitation
Sticking with a physical therapy program is one of the biggest challenges in rehabilitation. AR-based games and exercises aim to solve this by making repetitive movements more engaging. Instead of counting repetitions, a patient might interact with virtual objects overlaid on their real environment, turning therapeutic exercises into goal-oriented activities.
A feasibility study involving older adults found that participants reported high motivation to continue AR-based physical activity, scoring 5.67 out of 7 on a motivation scale and 4.15 out of 5 on intention to keep exercising. Beyond engagement, the study found significant improvements in visual reasoning after AR gameplay, with scores increasing from about 103 to 109 on an age-adjusted standard measure. While these results come from a small study, they suggest AR-based rehabilitation could support both physical adherence and cognitive function, especially in older populations.
Limitations and Practical Challenges
AR in healthcare is not without significant hurdles. The technology is expensive, and integrating it into existing hospital workflows takes time and training. Headset-based systems can cause fatigue during long procedures, and the accuracy of AR overlays depends entirely on the quality of the underlying imaging data and calibration. If the digital layer drifts even slightly out of alignment with a patient’s real anatomy, it could mislead rather than help.
Not every application has lived up to its promise. Infrared vein visualization devices, which use AR principles to project vein maps onto the skin’s surface, were expected to dramatically improve IV insertion success rates. Yet a randomized study in infants and toddlers found no significant difference in first-attempt success (61.3% with standard technique versus 54.4% with the device) or overall success rates. This is a useful reminder that AR is a tool, not a guaranteed upgrade, and its value depends on the specific clinical context.
Regulatory oversight is also still evolving. The FDA classifies AR systems used in clinical care as medical devices, meaning they must go through clearance processes before reaching the market. As the technology advances rapidly, regulators face the challenge of evaluating systems that may receive frequent software updates, each of which could change how the device performs in practice.