Back to articles
I Misspelled One Word and My AI Bill Jumped 400% đŸ˜±

I Misspelled One Word and My AI Bill Jumped 400% đŸ˜±

via Dev.toRam Bikkina

Think LLMs "read" like we do? Think again. Here is why your typos (and your code formatting) are costing you real money. So, there I was, scrolling through Instagram late at night—probably when I should’ve been sleeping—and I saw a weird trivia post. It asked: "Hello world" is 2 tokens, but "helloworld" is more than 2. Why? My brain went into "problem-solving mode." I thought, Okay, "Hello world" is just two common words. But "helloworld" isn't a real word, so the AI has to chop it up into smaller pieces. It sounded like a good guess, but "good guesses" aren't enough for me. I wanted to see the actual math. I jumped onto my computer, opened Cursor, and built a quick tool using gradio and some common AI "tokenizers" (the stuff that chops up words). I wanted to see exactly where the "cuts" happen and—most importantly—how much they cost. Here is what I found. Level 1: The "Lego" Rule (Spaces and Caps) First thing I learned? AI models are obsessed with patterns. If you break the pattern, y

Continue reading on Dev.to

Opens in a new tab

Read Full Article
2 views

Related Articles