Mostofa Patwary

Latest

• RLP: Reinforcement Learning Pre-training
• CLIMB: Clustering-based Iterative Data Mixture Bootstrapping for Language Model Pre-training
• Efficient Hybrid Language Model Compression through Group-Aware SSM Pruning
• Compact Language Models via Pruning and Knowledge Distillation