The process of adapting a large pre-trained model to a specific task or domain by continuing its training on a smaller, task-specific dataset — leveraging the general knowledge already encoded in the model.
In Depth
Fine-tuning begins where pre-training ends. A foundation model — BERT, GPT-4, LLaMA — has already learned rich, general representations from massive datasets. Fine-tuning takes this pre-trained model and continues training it on a smaller dataset specific to a particular task or domain: legal text, medical records, customer service dialogues, or code in a specific language. The model updates its weights slightly to specialize for the new data, while retaining the general knowledge from pre-training.
Fine-tuning is dramatically more efficient than training from scratch. A model that would require billions of examples and months of compute to train from zero can be fine-tuned to a new task in hours using thousands of examples. This efficiency arises from transfer learning: the pre-trained representations — grammar, world knowledge, reasoning patterns — are reusable. The fine-tuning step just needs to learn the task-specific adaptation on top of this foundation.
Modern fine-tuning techniques go beyond standard full fine-tuning (updating all parameters). Parameter-Efficient Fine-Tuning (PEFT) methods like LoRA (Low-Rank Adaptation) add small, trainable matrices to frozen model weights — achieving near-full fine-tuning performance with a fraction of the parameters and compute. RLHF (Reinforcement Learning from Human Feedback) is a specialized form of fine-tuning that uses human preference data to align model behavior, used to create ChatGPT, Claude, and similar systems.
Fine-tuning is how general-purpose AI becomes specialized expertise — the most efficient way to take a powerful foundation model and adapt it precisely to your specific data, task, or behavioral requirements.