1. [Publications](/publications) 2. Foveated AR: Dynamically-Foveated Augmented Reality Display # Foveated AR: Dynamically-Foveated Augmented Reality Display ![](/sites/default/files/styles/wide/public/publications/papers_297s2-file2_small.jpg?itok=-UCC8fL2) We present a near-eye augmented reality display with resolution and focal depth dynamically driven by gaze tracking. The display combines a traveling microdisplay relayed off a concave half-mirror magnifier for the high-resolution foveal region, with a wide field-of-view peripheral display using a projector-based Maxwellian-view display whose nodal point is translated to follow the viewer’s pupil during eye movements using a traveling holographic optical element. The same optics relay an image of the eye to an infrared camera used for gaze tracking, which in turn drives the foveal display location and peripheral nodal point. Our display supports accommodation cues by varying the focal depth of the microdisplay in the foveal region, and by rendering simulated defocus on the "always in focus" scanning laser projector used for peripheral display. The resulting family of displays significantly improves on the field-of-view, resolution, and formfactor tradeoff present in previous augmented reality designs. We show prototypes supporting 30, 40 and 60 cpd foveal resolution at a net 85° × 78° field of view per eye. ## Authors [Jonghyun Kim](/person/jonghyun-kim) Youngmo Jeong (NVIDIA, Seoul National University) [Michael Stengel](/person/michael-stengel) Kaan Akşit (NVIDIA) Rachel Albert (NVIDIA) [Ben Boudaoud](/person/ben-boudaoud) [Trey Greer](/person/trey-greer) [Joohwan Kim](/person/joohwan-kim) [Ward Lopes](/person/ward-lopes) Zander Majercik (NVIDIA) Peter Shirley (NVIDIA) [Josef Spjut](/person/josef-spjut) Morgan McGuire (NVIDIA) [David Luebke](/person/david-luebke) ## Publication Date Sunday, July 28, 2019 ## Published in SIGGRAPH 2019 Technical Paper ## Research Area [Computer Graphics](/research-area/computer-graphics) [VR, AR and Display Technology](/research-area/virtual-augmented-reality) ## External Links [Foveated AR Submission Video](https://www.youtube.com/watch?v=IknBUoRGUkM) ## Uploaded Files [Foveated\_AR](https://research.nvidia.com/sites/default/files/pubs/2019-07_Foveated-AR%3A-Dynamically-Foveated//Foveated_AR___v2%20%2815%29.pdf "Open file in new window")33.95 MB [Foveated\_AR\_\_Supplement](https://research.nvidia.com/sites/default/files/pubs/2019-07_Foveated-AR%3A-Dynamically-Foveated//Foveated_AR__Supplementary%20%2813%29.pdf "Open file in new window")50.14 MB ## Copyright Copyright by the Association for Computing Machinery, Inc. Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Publications Dept, ACM Inc., fax +1 (212) 869-0481, or . The definitive version of this paper can be found at ACM's Digital Library .