Skip to content

Radar ·

PHLoRA extracts LoRA adapters from fine-tuned models

Published on September 17, 2025, the post describes a method for extracting low-rank adapters from fine-tuned checkpoints without training data or gradients.

Published on September 17, 2025, the post describes PHLoRA, a method that uses base and fine-tuned checkpoints to extract a low-rank LoRA adapter through singular value decomposition. The reported process requires neither training data nor gradients.

The post says accuracy at ranks 32 or 64 is within about 1% of full-rank models, and notes potential reductions in adapter loading and serving costs when converting existing full-rank fine-tunes. To check the scope, method, and findings, consult the original post and verify its reported conditions and metrics.

Original source: PHLoRA extrai adapters LoRA de checkpoints fine-tuned

Curation · AgentLog

Get the essentials

Privacy, AI engineering and security in your inbox.

At most one digest per day, when there is news. Cancel at any time. We use your account's verified email.

Privacy

Looking for something else?DocumentationContact