Latest 9 min read
Small Language Models: Are We There Yet?
Small models now run on a laptop, but the general-purpose ones still trail the giants. Where they win is one narrow job, done in milliseconds for a fraction of a cent.
2 posts ยท 2026
Notes on software engineering, architecture and running systems in production.
Latest 9 min read
Small models now run on a laptop, but the general-purpose ones still trail the giants. Where they win is one narrow job, done in milliseconds for a fraction of a cent.
9 min read
Models draft correct, interchangeable emails. The fix is a dataset built backwards: take emails with a voice, let the model neutralize them, then flip the pairs.