1. [Publications](/publications) 2. Post-Render Warp with Late Input Sampling Improves Aiming Under High Latency Conditions # Post-Render Warp with Late Input Sampling Improves Aiming Under High Latency Conditions ![](/sites/default/files/styles/wide/public/publications/teaser800.jpg?itok=KRFTUqp5) End-to-end latency in remote-rendering systems can reduce user task performance. This notably includes aiming tasks on game streaming services, which are presently below the standards of competitive first-person desktop gaming. We evaluate the latency-induced penalty on task completion time in a controlled environment and show that it can be significantly mitigated by adopting and modifying image and simulation-warping techniques from virtual reality, eliminating up to 80\\% of the penalty from 80 ms of added latency. This has potential to enable remote rendering for esports and increase the effectiveness of remote-rendered content creation and robotic teleoperation. We provide full experimental methodology, analysis, implementation details, and source code. ## Authors [Joohwan Kim](/person/joohwan-kim) Pyarelal Knowles (NVIDIA) [Josef Spjut](/person/josef-spjut) [Ben Boudaoud](/person/ben-boudaoud) Morgan McGuire (NVIDIA) ## Publication Date Monday, July 13, 2020 ## Published in [High Performance Graphics 2020](https://www.highperformancegraphics.org/2020/) ## Research Area [Computer Graphics](/research-area/computer-graphics) [Esports](/research-area/esports) [Human Computer Interaction](/research-area/human-computer-interaction) [Hyperscale Graphics](/research-area/hyperscale-graphics) [Real-Time Rendering](/research-area/real-time-rendering) [VR, AR and Display Technology](/research-area/virtual-augmented-reality) ## External Links [DOI Link](https://doi.org/10.1145/3406187) ## Uploaded Files [Author Preprint](https://research.nvidia.com/sites/default/files/pubs/2020-07_Post-Render-Warp-with/HPG_2020_Latewarp_AuthorVersion_0.pdf "Open file in new window")13.77 MB [Supplement](https://research.nvidia.com/sites/default/files/pubs/2020-07_Post-Render-Warp-with/HPG_2020_Latewarp_Supplement_0.pdf "Open file in new window")585.84 KB [Submission Video](https://research.nvidia.com/sites/default/files/pubs/2020-07_Post-Render-Warp-with/HPG2020_SubmissionVideo.mp4 "Open video in new window")20.15 MB ## Copyright Copyright by the Association for Computing Machinery, Inc. Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, to republish, to post on servers, or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from Publications Dept, ACM Inc., fax +1 (212) 869-0481, or . The definitive version of this paper can be found at ACM's Digital Library .