Efficient AI
Efficient AI
News
Members
Publications
Light
Dark
Automatic
ICML2025
XAttention: Block Sparse Attention with Antidiagonal Scoring
Long-Context Transformer Models (LCTMs) are vital for real-world applications but suffer high computational costs due to attention’s …
Ruyi Xu
,
Guangxuan Xiao
,
Haofeng Huang
,
Junxian Guo
,
Song Han
PDF
Cite
Code
Slides
Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity
Diffusion Transformers (DiTs) dominate video generation but their high computational cost severely limits real-world applicability, …
Haocheng Xi
,
Shuo Yang
,
Yilong Zhao
,
Chenfeng Xu
,
Muyang Li
,
Xiuyu Li
,
Yujun Lin
,
Han Cai
,
Jintao Zhang
,
Dacheng Li
,
Jianfei Chen
,
Ion Stoica
,
Kurt Keutzer
,
Song Han
PDF
Cite
Code
Project
SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer
This paper presents SANA-1.5, a linear Diffusion Transformer for efficient scaling in text-to-image generation. Building upon SANA-1.0, …
Enze Xie
,
Junsong Chen
,
Yuyang Zhao
,
Jincheng Yu
,
Ligeng Zhu
,
Yujun Lin
,
Zhekai Zhang
,
Muyang Li
,
Junyu Chen
,
Han Cai
,
Bingchen Liu
,
Daquan Zhou
,
Song Han
PDF
Cite
Code
Project
Cite
×