LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuning

Rui Pan, Xiang Liu, Shizhe Diao, Renjie Pi, Jipeng Zhang, Chi Han, Tong Zhang
December 2024
arXiv
Type
Conference paper
Publication
Advances in Neural Information Processing Systems (NeurIPS)
Shizhe Diao
Shizhe Diao