1. [Publications](/publications)
2. Full-colour 3D holographic augmented-reality displays with metasurface waveguides
 
 # Full-colour 3D holographic augmented-reality displays with metasurface waveguides

  ![](/sites/default/files/styles/wide/public/publications/xr-glasses-1.jpg?itok=7gRaLJK7)

 Emerging spatial computing systems seamlessly superimpose digital information on the physical environment observed by a user, enabling transformative experiences across various domains, such as entertainment, education, communication and training[1](https://www.nature.com/articles/s41586-024-07386-0#ref-CR1),[2](https://www.nature.com/articles/s41586-024-07386-0#ref-CR2),[3](https://www.nature.com/articles/s41586-024-07386-0#ref-CR3). However, the widespread adoption of augmented-reality (AR) displays has been limited due to the bulky projection optics of their light engines and their inability to accurately portray three-dimensional (3D) depth cues for virtual content, among other factors[4](https://www.nature.com/articles/s41586-024-07386-0#ref-CR4),[5](https://www.nature.com/articles/s41586-024-07386-0#ref-CR5). Here we introduce a holographic AR system that overcomes these challenges using a unique combination of inverse-designed full-colour metasurface gratings, a compact dispersion-compensating waveguide geometry and artificial-intelligence-driven holography algorithms. These elements are co-designed to eliminate the need for bulky collimation optics between the spatial light modulator and the waveguide and to present vibrant, full-colour, 3D AR content in a compact device form factor. To deliver unprecedented visual quality with our prototype, we develop an innovative image formation model that combines a physically accurate waveguide model with learned components that are automatically calibrated using camera feedback. Our unique co-design of a nanophotonic metasurface waveguide and artificial-intelligence-driven holographic algorithms represents a significant advancement in creating visually compelling 3D AR experiences in a compact wearable device.



 ## Authors



Manu Gopakumar (Stanford University)

Gun-Yeal Lee (Stanford University)

Suyeon Choi (Stanford University)

Brian Chao (Stanford University)

Yifan Peng (The University of Hong Kong)

[Jonghyun Kim](/person/jonghyun-kim)

Gordon Wetzstein (Stanford University)

 

 

 ## Publication Date



Wednesday, May 8, 2024

 

 ## Published in



[Nature](https://www.nature.com/articles/s41586-024-07386-0)

 

 ## Research Area



[Artificial Intelligence and Machine Learning ](/research-area/machine-learning-artificial-intelligence)

[Computer Graphics](/research-area/computer-graphics)

[VR, AR and Display Technology](/research-area/virtual-augmented-reality)

 

 

 ## External Links



[Project page](https://www.computationalimaging.org/publications/holographicar/)

[Tech Blog](https://developer.nvidia.com/blog/developing-smaller-lighter-extended-reality-glasses-using-ai/)