glossarytech.com

qLoRA

A variation of LoRA that combines low rank adaptation with quantization. It further reduces memory requirements.

First released2023
Developed byUniversity of Washington
Open-sourceYes

Interesting facts

qLORA enabled fine tuning of large models on single consumer GPUs.

Sign up for updates
straight to your inbox

Subscribe