Chapter 5 · 5 min
Seeing, hearing, speaking
It describes your photos and answers you out loud. Not bad for a word-predicting machine.
You take a photo of the inside of your fridge and ask: “What can I cook tonight?” It answers by naming what it sees.
Guess first
It only reads tokens. So how does it see your photo?