Efficient AI
Efficient AI
News
Blog
Publications
Light
Dark
Automatic
LLM
Nemotron-Labs-Diffusion: A Tri-Mode Language Model Unifying Autoregressive, Diffusion, and Self-Speculation Decoding
We introduce Nemotron-Labs-Diffusion, a tri-mode language model (LM) that unifies AR, diffusion, and self-speculation decoding within a …
Yonggan Fu
,
Lexington Whalen
,
Abhinav Garg
,
Chengyue Wu
,
Maksim Khadkevich
,
Nicolai Oswald
,
Enze Xie
,
Daniel Egert
,
Sharath Turuvekere Sreenivas
,
Shizhe Diao
,
Chenhan D. Yu
,
Ye Yu
,
Weijia Chen
,
Sajad Norouzi
,
Jingyu Liu
,
Shiyi Lan
,
Ligeng Zhu
,
Jin Wang
,
Jindong Jiang
,
Morteza Mardani
,
Mehran Maghoumi
,
Song Han
,
Ante Jukić
,
Nima Tajbakhsh
,
Jan Kautz
,
Pavlo Molchanov
PDF
Cite
Source Document
DOI
Models
Efficient-DLM: From Autoregressive to Diffusion Language Models, and Beyond in Speed
Diffusion language models (dLMs) have emerged as a promising paradigm that enables parallel, non-autoregressive generation, but their …
Yonggan Fu
,
Lexington Whalen
,
Zhifan Ye
,
Xin Dong
,
Shizhe Diao
,
Jingyu Liu
,
Chengyue Wu
,
Hao Zhang
,
Enze Xie
,
Song Han
,
Maksim Khadkevich
,
Jan Kautz
,
Yingyan Celine Lin
,
Pavlo Molchanov
PDF
Cite
Source Document
Model (4B)
Model (8B)
Cite
×