What is fine-tuning?
Mark reads in the news that a company is fine-tuning its own model, and wants to know what fine-tuning means.
MEANING
Extra training for a trained model
Bit explains: fine-tuning is extra training, adjusting a model that has already finished learning with a special set of examples. Like someone who finished high school taking a job training course.
EXAMPLE
A real example
For example: give it thousands of customer service conversations, and the model learns that company's tone and way of handling things.
COMPARISON
Different from prompts and RAG
It's different from a prompt, which gives instructions every time you ask, or RAG, which lets it look things up in documents, as in video 25. Fine-tuning changes the model's own habits.
REMEMBER
When you see this word
When you see this word, think: extra training for the model. Everyday users rarely need it. Good prompts and good documents solve most things.
This article is based on the video What is fine-tuning? from the Mark học AI channel. Watch the video (in Vietnamese) to see the animations.