Mark học AI

Video #20 · Inside AI's brain · Part 2/8

What is an embedding? How AI understands word meaning with a map

Last time, AI turned words into numbers. But how can numbers carry meaning?

Watch videoVideo in Vietnamese

So what do the numbers mean?

Last time, we saw AI cut a sentence into pieces and turn them into numbers. So how do those numbers carry meaning? Let's see.

A map of meaning

AI places every word on a giant map. Words with similar meanings sit close together. Cat is next to dog, while truck is far away.

Coordinates are meaning

A word's spot on the map is its meaning, written as a list of numbers. To tell how similar two words are, AI just measures the distance.

Math with meaning

This map can even do math. Take king, subtract man, add woman, and you land very close to queen.

You already use it

You use it every day. Type dog on the beach into your photo app, and the photos show up even though you never named them. The search works by meaning, not exact words.

What about a whole sentence?

But a sentence has a dozen words. AI has to find which words matter, and who "it" refers to. Part three explains that.

This article is based on the video AI understands meaning with a map from the Mark học AI channel. Watch the video (in Vietnamese) to see the animations.