Guides ·
Legal LLM fine-tuning with LoRA and the hold-out set lesson
An author reports fine-tuning a Llama for a legal task with LoRA and Unsloth notebooks. The model memorized the training data, performed worse than the base model on new examples, and the lesson is to validate with a hold-out set.