Training a 3.8B LLM to 0.384 CORE for $998 – Hugo Vergnes

A 3.8B model pretrained from scratch to 0.384 CORE on 65B tokens in 43 hours, for $998.
98 points by Anon84 42 days ago hugovergnes.github.io 14 comments
Summary not yet generated for this article.

Comments (14 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open