GitHub - vixhal-baraiya/microgpt-c: The most atomic way to train and inference a GPT in pure, dependency-free C

Microgpt in pure C hits 10M tps on Apple m5

The most atomic way to train and inference a GPT in pure, dependency-free C - vixhal-baraiya/microgpt-c

114 points by dhorthy 64 days ago github.com 38 comments

Summary

A new implementation of GPT in pure C has achieved an impressive 10 million transactions per second on the Apple M5. This project, microgpt-c, focuses on minimalism by eliminating dependencies, making it a notable advancement in efficiency for AI processing.

Comments (38 of ) ⌛

Loading more comments... ⌛

Scroll down to load more comments

No comments available.