Mark học AI

Video #24 · Inside AI's brain · Part 6/8

Why does AI give different answers to the same question? What temperature is

Ask AI the same question twice and get two different answers? It's not a bug.

Watch videoVideo in Vietnamese

Ask twice, get two answers?

Last time, AI learned to answer like an assistant. But ask the same question twice, and you get two different answers. Why?

Scoring a hundred options

Remember: AI guesses the next piece of text. But it doesn't guess just one word. It scores a hundred options. Coffee 40%, bubble tea 25%, and so on.

A prize wheel

Then it draws one based on those odds, like a prize wheel where bigger slices are easier to hit. This time it lands on coffee, next time maybe bubble tea.

The "temperature" knob

This amount of chance has a knob, called temperature. Low temperature: steady, almost the same every time. High temperature: playful and creative, but more likely to drift off topic.

Every word is a new draw

Every word is a new draw. One different word at the start, and the whole rest of the answer goes a different way.

Your own documents

No matter how well AI guesses, it doesn't know your own contracts or documents. Unless you give them to it. Part seven shows how.

This article is based on the video Why does asking twice give two answers? from the Mark học AI channel. Watch the video (in Vietnamese) to see the animations.