What's in a GGUF, besides the weights – and what's still missing?

What extra stuff is needed to properly run a language model? Besides the weights of a language model, what is the gguf metadata that we need to parse and use?
160 points by bashbjorn 160 days ago nobodywho.ooo 49 comments
Summary not yet generated for this article.

Comments (49 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open