LoRA (Low-Rank Adaptation) — AI Glossary

LoRA (Low-Rank Adaptation) is a parameter-efficient fine-tuning technique that adapts a pre-trained AI model to new tasks by injecting small trainable matrices into the model's layers while keeping the original weights frozen. LoRA can reduce the number of trainable parameters by up to 10,000 times compared to full fine-tuning, making it possible to customize large models on consumer-grade hardware.