Sushant Veer

I am a Research Scientist with the Autonomous Vehicle Research Group at NVIDIA Research. Broadly, my research interests lie in ensuring the safety of complex autonomous robotic systems. I am currently interested in improving the safety of autonomous vehicles by equipping them with the ability to detect and safely address edge cases that lie beyond the operational design domain.

Cédric Augonnet

Linxi "Jim" Fan

Please visit my personal website! https://jimfan.me

Mahmut Ersin Sinangil

Vinu Joseph

Working on Privacy Preserving Deep Learning using:

Amrita Mazumdar

Amrita Mazumdar joined NVIDIA Research in 2021. Her research interests are at the intersection of computer systems and computer graphics.

She received her PhD (2020) and MS (2017) from the University of Washington, and her BS (2014) from Columbia University. Previously, she founded Vignette AI, where she worked on perception-aware video compression and storage.

Danfei Xu

Karen Leung

I am a research scientist working with NVIDIA's Autonomous Vehicle Research Group. My research interests include safe and interaction-aware planning and control for autonomous vehicles, and developing structured and interpretable deep learning models grounded by logic.

Benedikt Bitterli

Softermax: Hardware/Software Co-Design of an Efficient Softmax for Transformers

Transformers have transformed the field of natural language processing. This performance is largely attributed to the use of stacked self-attention layers, each of which consists of matrix multiplies as well as softmax operations. As a result, unlike other neural networks, the softmax operation accounts for a significant fraction of the total run-time of Transformers. To address this, we propose Softermax, a hardware-friendly softmax design. Softermax consists of base replacement, low-precision softmax computations, and an online normalization calculation.

Subscribe to