Efficient AI
Efficient AI
News
Blog
Publications
Light
Dark
Automatic
Diffusion
Nemotron-Labs-Diffusion: A Tri-Mode Language Model Unifying Autoregressive, Diffusion, and Self-Speculation Decoding
We introduce Nemotron-Labs-Diffusion, a tri-mode language model (LM) that unifies AR, diffusion, and self-speculation decoding within a …
Yonggan Fu
,
Lexington Whalen
,
Abhinav Garg
,
Chengyue Wu
,
Maksim Khadkevich
,
Nicolai Oswald
,
Enze Xie
,
Daniel Egert
,
Sharath Turuvekere Sreenivas
,
Shizhe Diao
,
Chenhan D. Yu
,
Ye Yu
,
Weijia Chen
,
Sajad Norouzi
,
Jingyu Liu
,
Shiyi Lan
,
Ligeng Zhu
,
Jin Wang
,
Jindong Jiang
,
Morteza Mardani
,
Mehran Maghoumi
,
Song Han
,
Ante Jukić
,
Nima Tajbakhsh
,
Jan Kautz
,
Pavlo Molchanov
PDF
Cite
Source Document
DOI
Models
Fast-dVLM: Efficient Block-Diffusion VLM via Direct Conversion from Autoregressive VLM
Vision-language models (VLMs) predominantly rely on autoregressive decoding, which generates tokens one at a time and fundamentally …
Chengyue Wu
,
Shiyi Lan
,
Yonggan Fu
,
Sensen Gao
,
Jin Wang
,
Jincheng YU
,
Jose M. Alvarez
,
Pavlo Molchanov
,
Ping Luo
,
Song Han
,
Ligeng Zhu
,
Enze Xie
PDF
Cite
Code
Project
Efficient-DLM: From Autoregressive to Diffusion Language Models, and Beyond in Speed
Diffusion language models (dLMs) have emerged as a promising paradigm that enables parallel, non-autoregressive generation, but their …
Yonggan Fu
,
Lexington Whalen
,
Zhifan Ye
,
Xin Dong
,
Shizhe Diao
,
Jingyu Liu
,
Chengyue Wu
,
Hao Zhang
,
Enze Xie
,
Song Han
,
Maksim Khadkevich
,
Jan Kautz
,
Yingyan Celine Lin
,
Pavlo Molchanov
PDF
Cite
Source Document
Model (4B)
Model (8B)
Cite
×