LLM Pruning and Distillation in Practice: The Minitron Approach

Publication image

Authors

Sharath Turuvekere Sreenivas
Raviraj Joshi
Marcin Chochowski
Mostofa Patwary (NVIDIA)
Mohammad Shoeybi (NVIDIA)
Bryan Catanzaro (NVIDIA)

Publication Date