Ask an AI how many r’s are in “strawberry” and it has famously said two.
So why would a smart AI miss something a child gets right?
It’s not a bug. It’s tokenisation, and it shows up in real interview questions:
→ why can’t AI count letters?
→ why does it slip on long sums?
→ why do some languages cost more?
→ why does one space matter?
One answer covers all four, explained simply, with real ChatGPT examples 👀
Part 3 of a 3-part series on tokenisation.
Stay till the end for a cheat sheet worth screenshotting 📸
#Tokenization #LLM #Shorts
source