Mark học AI

Video #54 · AI's senses · Part 5/6

How does AI make video from a prompt? Why hands and text often break

Type "a cat riding a cyclo through the old quarter", and a moment later there's a clip. How does AI do it?

Watch videoVideo in Vietnamese

Type a sentence, get a clip

Last time, AI watched video. Now flip it: AI makes video. Type a sentence: "a cat riding a cyclo through the old quarter". A moment later, there's a clip.

QUICK REMINDER

Removing noise, remember?

In the video about drawing pictures, AI started from a screen of grainy static and slowly cleaned it up to match your words. Video works the same way, but it cleans a whole stack of frames at once.

TIME

The hard part: every frame must match

The hard part is time. Clean each frame on its own, and the cat is black in one frame and orange in the next. So AI cleans the whole sequence at once, so each frame matches the next.

CONSISTENCY

Characters can't change faces

That way, characters keep the same face and clothes, and the scene doesn't jump around. The longer the video, the harder this gets.

COMMON MISTAKES

Hands and text often break

But hands are often drawn wrong: extra fingers, fingers stuck together. Text on signs gets warped, because AI draws the shape of letters instead of writing each one.

PHYSICS

Looks real, breaks the rules

Physics often goes wrong too: a glass tips over but the water doesn't spill, a person walks through a door. AI copies what looks real, without truly understanding how the world works.

PART 6

All in one brain?

Listening, talking, watching, making video. It's all coming together into one brain. How well can a brain like that understand you? See you in part 6, the last part.

This article is based on the video AI makes a video from one sentence from the Mark học AI channel. Watch the video (in Vietnamese) to see the animations.