Why are Graph Neural Networks Effective for EDA Problems?

In this paper, we discuss the source of effectiveness of Graph Neural Networks (GNNs) in EDA, particularly in the VLSI design automation domain. We argue that the effectiveness comes from the fact that GNNs implicitly embed the prior knowledge and inductive biases associated with given VLSI tasks, which is one of the three approaches to make a learning algorithm physics-informed. These inductive biases are different to those common used in GNNs designed for other structured data, such as social networks and citation networks.

Photonic Circuits for Accelerated Computing Systems

GPU-based accelerated computing is powering the AI revolution. These systems include processors and switches which push thermal power density limits while demanding large I/O bandwidths. To continue scaling, very dense integration of ultra-efficient optical transceivers is called for to alleviate current inefficiencies in off-package signalling.

Merlin Nimier-David

Merlin is a senior research scientist at NVIDIA. His research focuses on differentiable physically based rendering, including how to efficiently and accurately computing gradients through rendering algorithms. These gradients can then be leveraged in a variety of inverse tasks, such as recovering the materials and lighting from photographs. He contributed to the development of the Mitsuba differentiable renderer.

HEAT: Hardware-Efficient Automatic Tensor Decomposition for Transformer Compression

Transformers have attained superior performance in natural language processing and computer vision. Their self-attention and feedforward layers are overparameterized, limiting inference speed and energy efficiency. Tensor decomposition is a promising technique to reduce parameter redundancy by leveraging tensor algebraic properties to express the parameters in a factorized form. Prior efforts used manual or heuristic factorization settings without hardware-aware customization, resulting in poor hardware efficiencies and large performance degradation. 

Display Size and Targeting Performance: Small Hurts, Large May Help

Which display size helps gamers win? Recommendations from the research and PC gaming communities are contradictory. We find that as display size grows, targeting performance improves. When size increases from 13" to 26", targeting time drops by over 3%. Further size increases from 26" through 39", 52" and 65", bring more modest improvements, with targeting time dropping a further 1%. While such improvements may not be meaningful for novice gamers, they are extremely important to skilled and competitive players.

Esports and expertise: what competitive gaming can teach us about mastery

Historically, much research and development in human computer interaction has focused on atomic and generalizable tasks, where task completion time indicates productivity. However, the emergence of competitive games and esports reminds us of an alternative perspective on human performance in HCI: mastery of higher-level, holistic practices. Just as a world-renowned artist is rarely evaluated for their individual brush strokes, so skilled competitive gamers rarely succeed solely by completing individual mouse movements or keystrokes as quickly as possible.

Szu-Wei Fu

Szu-Wei Fu joined NVIDIA Research in November 2022. His current interests include ML-based audio-visual processing, speech processing/enhancement, and quality estimation. Before Joined NVIDIA, he was an applied scientist in Microsoft.

Mingjie Liu

Mingjie Liu is currently a Research Scientist at NVIDIA, where he actively conduct research on Electronic Design Automation. He received his PhD degree in electrical and computer engineering from the The University of Texas at Austin in 2022. His research interest include applied machine learning for design automation and design automation for analog and mixed-signal integrated circuits.

Min-Hung Chen

Min-Hung (Steve) Chen is a Senior Research Scientist at NVIDIA Research Taiwan, working on Vision+X Multi-Modal AI. He received his Ph.D. degree from Georgia Tech, advised by Prof. Ghassan AlRegib and in collaboration with Prof. Zsolt Kira.