Can gzip be a language model?
A while back I wrote about language modeling without neural networks, where I generated Shakespeare with an unbounded n-gram model: no weights, no training, …
Summary
The article discusses the potential of using gzip, a data compression tool, for language modeling without relying on neural networks. It highlights an innovative approach to generating text, such as Shakespeare, through an unbounded n-gram model.
Comments (161 of ) ⌛