Tags /
4 posts
My ebook pipeline's top-ranked pick for Atomic Habits was a 115-page abridged edition with perfect metadata. So I put an LLM judge in the pipeline, benchmarked eleven models on ten fixed candidates with five runs each, and watched the only real data loss of the week come from deterministic code instead.
The week I added an LLM safety gate to a file pipeline, the only data loss came from deterministic code: a CLI that silently refused an operation, a fallback that guessed an identity, and a verifier that faithfully verified the wrong object. A short postmortem, and the argument for auditing your boring layers.
Twenty client domains made Postmark's per-domain math ugly, so I built Balodis: a multi-tenant transactional email service on Amazon SES. One day, 110 tests, about $13 a month. With an interactive calculator so you can run the build-vs-buy numbers yourself.
filmoteka's parser silently dropped 22% of real releases, every one multilingual. I benchmarked four GLM tiers against it on 115 real titles, five runs each. Every tier recovered all of them; only the paid ones did it without ever grabbing the wrong film.