Learning on LoRAs: GL-Equivariant Processing of Low-Rank Weight Spaces for Large Finetuned Models

Theo Putterman, Derek Lim, Yoav Gelberg, Michael Bronstein, Stefanie Jegelka, Haggai Maron

May 2025 Machine Learning

Type

Conference paper

Publication

ICLR 2025 Workshop: Neural Network Weights as a New Data Modality

Equivariance Weight Space