Does Matching Matter More Than Minimizing? AR Latency and Registration
Goal
Determine whether matching real-world and virtual-world latency levels in AR systems produces better task performance than simply minimizing overall latency — with direct implications for AR training system design.
Challenge
Comparing real AR systems experimentally is impossible without losing control over confounding variables. Prior work couldn't isolate latency type (real-world vs. virtual) independently — so the relative effect of each on registration quality and performance was unknown.
Approach
Built an AR simulation inside VR (CAVE system) to precisely control latency parameters that would be uncontrollable in actual AR hardware
Tested 7 conditions across 30 participants (12F, 18M), simulating optical see-through (OST) and video see-through (VST) AR at matched and unmatched latency levels:
Condition | Real-world Latency | Virtual Latency | Registration |
|---|---|---|---|
Baseline | 0ms | 0ms | Perfect |
Low OST | 0ms | 25ms | Mismatched |
Low VST matched | 25ms | 25ms | Perfect |
Low VST unmatched | 25ms | 50ms | Mismatched |
High OST | 0ms | 75ms | Mismatched |
High VST matched | 75ms | 75ms | Perfect |
High VST unmatched | 75ms | 150ms | Mismatched |
Task: military forward observer simulation — tracking aerial drops onto targets at 400–650 ft using both unaided view and 4× virtual binoculars
My Role
Lead researcher responsible for study design, AR simulation platform development, experiment execution, and analysis.
Key Findings
Matched latency conditions produced significantly better accuracy than unmatched ones (p<0.0001) — even when total latency was higher
High VST matched (75ms/75ms) outperformed low OST (0ms/25ms) — a higher-latency system with perfect registration beat a lower-latency system with misregistration
Misregistration error grew with later targets — users in unmatched conditions fell progressively behind, unable to recover
3 clearly separated accuracy groups emerged: perfect registration (error ~0.4–1.2), some misregistration (~3.5), significant misregistration (~10)
Subjective ratings showed significant interaction effects on difficulty, irritation, naturalness, and perceived precision (all p<0.05)
Key design implication: for registration-critical tasks, AR designers should consider deliberately adding real-world latency to match virtual latency rather than optimizing total latency alone










