LoRA+ proposes distinct learning rates for adapter matrices
Dated September 24, 2026, the summary describes an analysis of equal learning rates for LoRA matrices A and B and a proposal to use different rates in wide models.
The item, dated September 24, 2026, says the article analyzes how using the same learning rate for LoRA matrices A and B may hinder feature learning in wide models. Its proposal is to use different rates during fine-tuning. The summary provides no values, experiments, or quantitative results, so it does not establish the size of the effect.
To check the claim, consult the original article and examine how it defines the rates, which models and configurations it evaluates, and what evidence it presents. If you use AI to study or apply the material, avoid submitting personal data or internal information without authorization, and verify conclusions against the original publication.