Publications

Qingqing Zhao, Yao (Jason) Lu, Moo Jin Kim, Zipeng Fu, Zhuoyang Zhang, Yecheng Wu, Max Li, Qianli Ma, Song Han, Chelsea Finn, Ankur Handa, Ming-Yu Liu, Donglai Xiang, Gordon Wetzstein, Tsung-Yi Lin (2025). CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models. CVPR2025.

PDF Cite Project

Baifeng Shi, Boyi Li, Han Cai, Yao (Jason) Lu, Sifei Liu, Marco Pavone, Jan Kautz, Song Han, Trevor Darrell, Pavlo Molchanov, Hongxu Yin (2025). PS3: Vision Pre-Training at 4K Resolution. CVPR2025.

PDF Cite Code Project Weights

Ruyi Xu, Guangxuan Xiao, Haofeng Huang, Junxian Guo, Song Han (2025). XAttention: Block Sparse Attention with Antidiagonal Scoring. ICML2025.

PDF Cite Code Slides

Junsong Chen, Shuchen Xue, Yuyang Zhao, Jincheng Yu, Sayak Paul, Junyu Chen, Han Cai, Enze Xie, Song Han (2025). SANA-Sprint: One-Step Diffusion with Continuous-Time Consistency Distillation.

PDF Cite Code Project

Zhijian Liu, Ligeng Zhu, Baifeng Shi, Zhuoyang Zhang, Yuming Lou, Shang Yang, Haocheng Xi, Shiyi Cao, Yuxian Gu, Dacheng Li, Xiuyu Li, Yunhao Fang, Yukang Chen, Cheng-Yu Hsieh, De-an Huang, An-Chieh Cheng, Vishwesh Nath, Jinyi Hu, Sifei Liu, Ranjay Krishna, Daguang Xu, Xiaolong Wang, Pavlo Molchanov, Jan Kautz, Hongxu Yin, Song Han, Yao (Jason) Lu (2025). NVILA: Efficient Frontier Visual Language Models. CVPR2025.

PDF Cite Code Project Demo Models Subscribe

Haocheng Xi, Shuo Yang, Yilong Zhao, Chenfeng Xu, Muyang Li, Xiuyu Li, Yujun Lin, Han Cai, Jintao Zhang, Dacheng Li, Jianfei Chen, Ion Stoica, Kurt Keutzer, Song Han (2025). Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity. ICML2025.

PDF Cite Code Project

Enze Xie, Junsong Chen, Yuyang Zhao, Jincheng Yu, Ligeng Zhu, Yujun Lin, Zhekai Zhang, Muyang Li, Junyu Chen, Han Cai, Bingchen Liu, Daquan Zhou, Song Han (2025). SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer. ICML2025.

PDF Cite Code Project

Muyang Li, Yujun Lin, Zhekai Zhang, Tianle Cai, Xiuyu Li, Junxian Guo, Enze Xie, Chenlin Meng, Jun-Yan Zhu, Song Han (2024). SVDQuant: Absorbing Outliers by Low-Rank Components for 4-Bit Diffusion Models. ICLR2025.

PDF Cite Code Project Video Demo Blog

Haocheng Xi, Han Cai, Ligeng Zhu, Yao (Jason) Lu, Kurt Keutzer, Jianfei Chen, Song Han (2024). COAT: Compressing Optimizer states and Activation for Memory-Efficient FP8 Training. ICLR2025.

PDF Cite Code Project Demo

Enze Xie, Junsong Chen, Junyu Chen, Han Cai, Haotian Tang, Yujun Lin, Zhekai Zhang, Muyang Li, Ligeng Zhu, Yao (Jason) Lu, Song Han (2024). SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformer. ICLR2025.

PDF Cite Code Project MIT Project Demo

Guangxuan Xiao, Jiaming Tang, Jingwei Zuo, Junxian Guo, Shang Yang, Haotian Tang, Yao Fu, Song Han (2024). DuoAttention: Efficient Long-Context LLM Inference with Retrieval and Streaming Heads. ICLR2025.

PDF Cite Code Project

Junyu Chen, Han Cai, Junsong Chen, Enze Xie, Shang Yang, Haotian Tang, Muyang Li, Yao (Jason) Lu, Song Han (2024). Deep Compression Autoencoder for Efficient High-Resolution Diffusion Models. ICLR2025.

PDF Cite Code Project

Song Han, Xingyu Liu, Huizi Mao, Jing Pu, Ardavan Pedram, Mark A. Horowitz, William J. Dally (2023). Retrospective: EIE: Efficient Inference Engine on Sparse and Compressed Neural Network.

PDF Cite

Xuanyao Chen, Zhijian Liu, Haotian Tang, Li Yi, Hang Zhao, Song Han (2023). SparseViT: Revisiting Activation Sparsity for Efficient High-Resolution Vision Transformer. CVPR.

PDF Cite Code Project Poster

Zhijian Liu, Xinyu Yang, Haotian Tang, Shang Yang, Song Han (2023). FlatFormer: Flattened Window Attention for Efficient Point Cloud Transformer. CVPR.

PDF Cite Code Project Poster

Zhijian Liu, Haotian Tang, Alexander Amini, Xinyu Yang, Huizi Mao, Daniela L. Rus, Song Han (2022). BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representation. ICRA2023.

PDF Cite Code Project Poster Video