A brain just put together
We have the machine: cutting into pieces, the map of meaning, attention. But when it's just built, it knows nothing at all.
Reading a whole library
Then people let it read. A huge amount of text: web pages, books, articles, even computer code. More than one person could read in a thousand lifetimes.
Learning by guessing words
The way it learns is simple: hide the next word and make it guess. If it's wrong, it adjusts a little. Repeat billions of times, and it picks up grammar, facts and even how to reason.
The cutoff date
But the reading has to stop on a certain day, called the cutoff date. AI knows nothing about what happened after that day.
What about the latest news?
So if you ask about today's gold price, a new law or this week's news, AI may answer with old information, and still sound very sure.
It can only continue sentences
After reading the whole library, AI only knows how to continue a sentence, not how to answer questions. So how did it become a polite assistant? Part five has the answer.
This article is based on the video What did AI "read" to get smart? from the Mark học AI channel. Watch the video (in Vietnamese) to see the animations.