Blog
Notes on tokenization, prompt cost, and getting more out of fewer tokens.
·6 min read
The cheapest per-token model is not reliably the cheapest bill, and the most capable one is not reliably worth it. A short decision procedure based on the shape of your workload rather than on benchmark scores.
View More·6 min read
A context window is a hard ceiling on input and output combined, and it varies by a factor of sixty across current models. Here is what each one actually holds, and why filling it is rarely the goal.
View MoreA forecast you can defend takes four numbers and about ten minutes. The estimates that go badly wrong usually miss the same three things — and none of them appear on a pricing page.
View MoreThe gap between the cheapest and most expensive model on an identical request is roughly 58x. Here is the arithmetic on a realistic workload, and why the cheapest per-token price is not always the cheapest bill.
View MoreThe same amount of information can cost two or three times as much when it arrives as code instead of English. The reason is in how tokenizers were built, and most of the overhead is avoidable.
View MoreMost prompts carry 20–40% padding that contributes nothing to the answer. These are the edits that shrink the bill while leaving the output intact.
View More·4 min read
Every provider ships its own tokenizer, so the same paragraph can cost meaningfully more on one model than another. Here's what actually drives the number.
View More