Skip to main content
Drop a repoSign up
REPOLum1104/Understand-Anything+606 stars 24hREPOanthropics/financial-services-plugins+396 stars 24hREPOrohitg00/ai-engineering-from-scratch+331 stars 24hREPOaddyosmani/agent-skills+327 stars 24hREPOcolbymchenry/codegraph+327 stars 24hREPOLum1104/Understand-Anything+606 stars 24hREPOanthropics/financial-services-plugins+396 stars 24hREPOrohitg00/ai-engineering-from-scratch+331 stars 24hREPOaddyosmani/agent-skills+327 stars 24hREPOcolbymchenry/codegraph+327 stars 24h
Glossary

What is LoRA (Low-Rank Adaptation)?

LoRA is a parameter-efficient fine-tuning method that trains small adapter matrices instead of the full model, cutting the cost of customising an LLM dramatically.

LoRA freezes the base model's weights and learns small low-rank update matrices, so the trained artifact is tiny and can be swapped or stacked on top of the base. This brought fine-tuning within reach of a single GPU and made custom models practical for small teams.

Open-source toolchains support LoRA out of the box, and QLoRA adds quantization so even large base models can be adapted on modest hardware.

Trending AI & ML projects

Trending LoRA (Low-Rank Adaptation) projects

  1. Fincept-Corporation/FinceptTerminal

    FinceptTerminal is a modern finance application offering advanced market analytics, investment research, and economic data tools, designed for interactive exploration and data-driven decision-making in a user-friendly environment.

    24K+56 · 24hmomentum 10Python

LoRA (Low-Rank Adaptation) — FAQ

What is LoRA (Low-Rank Adaptation)?
LoRA is a parameter-efficient fine-tuning method that trains small adapter matrices instead of the full model, cutting the cost of customising an LLM dramatically. LoRA freezes the base model's weights and learns small low-rank update matrices, so the trained artifact is tiny and can be swapped or stacked on top of the base. This brought fine-tuning within reach of a single GPU and made custom models practical for small teams.