- Published on
(Part 3) Sampling strategies and why inference optimizations pose a security tradeoff
Latest
Hey there! My name is Anirudh. I like figuring out how things work — and writing about it now and then.
- Published on
(Part 2) The inference side of transformers, along with systems tricks that make production LLMs fast- Published on
(Part 1) BPE Tokenizers under the hood, and where tokenization breaks math, spelling and code
Get an email when the next blog is published! No spam.