glossarytech.com

LoRA

A technique that adapts large language models using a small number of additional parameters. It reduces training cost and resource usage.

First released2021
Developed byMicrosoft Research
Open-sourceYes

Interesting facts

LoRA made fine tuning large models more accessible on limited hardware.

Sign up for updates
straight to your inbox

Subscribe