Research

Near-Eye Light Field Displays

"Near-Eye Light Field Displays"
Douglas Lanman (NVIDIA), David Luebke (NVIDIA), in ACM Transactions on Graphics (TOG), Volume 32 Issue 6, November 2013 (Proceedings of SIGGRAPH Asia), November 2013
Research Area: 3D Graphics
Stereoscopic 3D
Author(s): Douglas Lanman (NVIDIA), David Luebke (NVIDIA)
Date: November 2013
Download(s):
Project VideoElectricTV Interview Video
 
Abstract: We propose near-eye light field displays that enable thin, lightweight head-mounted displays (HMDs) capable of presenting nearly correct convergence, accommodation, binocular disparity, and retinal defocus depth cues. Sharp images are depicted by out-of-focus elements by synthesizing light fields corresponding to virtual objects within a viewer's natural accommodation range. We formally assess the capabilities of microlens arrays to achieve practical near-eye light field displays. Building on concepts shared with existing integral imaging displays and light field cameras, we optimize performance in the context of near-eye viewing. We establish fundamental trade-offs between the quantitative parameters of resolution, field of view, and depth of field, as well as the ergonomic parameters of form factor and ranges of allowed eye movement. As with light field cameras, our design supports continuous accommodation of the eye throughout a finite depth of field; as a result, binocular configurations provide a means to address the accommodation-convergence conflict occurring with existing stereoscopic displays. We construct a complete prototype display system, comprising: a custom-fabricated HMD using modified off-the-shelf parts and real-time, GPU-accelerated light field renderers (including a general ray tracing method and a "backward compatible" rasterization method supporting existing stereoscopic content). Through simulations and experiments, we motivate near-eye light field displays as thin, lightweight alternatives to conventional near-eye displays.