Fine Tuning Glossary
Browse 5 fine tuning terms defined in plain English, from the cultural dictionary of computing.
5 Fine Tuning Terms
- Adapter Layer
- A small trainable module inserted into a larger pre-trained model for parameter-efficient adaptation. It influences how models are trained, evaluated, or...
- LoRA
- Low-Rank Adaptation — a parameter-efficient fine-tuning technique that freezes the pre-trained model weights and injects small trainable matrices (adapters)...
- Low-Rank Adaptation
- A parameter-efficient fine-tuning method, commonly known as LoRA, that updates low-rank matrices instead of all model weights. Low-rank adaptation makes it...
- Merging Models
- Combining the weights or learned deltas of multiple models into a new model, usually to blend capabilities without full retraining.
- Parameter Efficient
- Describing methods that achieve adaptation or performance gains while changing only a small subset of parameters instead of retraining or updating an entire...
Related Topics
- Ai (2 terms in common)
- Llm (2 terms in common)
- Efficiency (2 terms in common)
- Architecture (1 terms in common)
- Model Weights (1 terms in common)
- Open Models (1 terms in common)
- Adaptation (1 terms in common)