Why LLMs Can Seem So Dumb to Experienced Developers
Why we judge probabilistic systems using deterministic expectations, and why the model is often missing parameters we already carry in our heads.
Field notes
I am documenting the engineering problems I keep running into with AI, what I tried, what failed, what changed and what I learned from building around those failures.
The opening series starts with the distinction that changed how I think about LLMs, then follows the engineering consequences one by one.
Why we judge probabilistic systems using deterministic expectations, and why the model is often missing parameters we already carry in our heads.
What comes next
Future field notes will stay unannounced until the underlying work is ready for public review.