lucalp.dev

The bitter lesson is coming for tokenization

The desire to replace tokenization with a general method that better leverages compute and data.