Mohammad Shoeybi

Latest

• RLP: Reinforcement Learning Pre-training
• Efficient Hybrid Language Model Compression through Group-Aware SSM Pruning
• Compact Language Models via Pruning and Knowledge Distillation
• An Empirical Study of Mamba-based Language Models
• VILA: On pretraining for vision language models