Sparse

XAttention: Block Sparse Attention with Antidiagonal Scoring
Long-Context Transformer Models (LCTMs) are vital for real-world applications but suffer high computational costs due to attention’s …
PDF Cite Code Slides
XAttention: Block Sparse Attention with Antidiagonal Scoring
Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity
Diffusion Transformers (DiTs) dominate video generation but their high computational cost severely limits real-world applicability, …
PDF Cite Code Project
Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity