GitHub - Low-Zi-Hong/ESP32s3-LLM-Cluster: 7-node ESP32-S3 cluster running a 0.4B LLM via 1.58-bit (BitNet) ternary quantization over SPI daisy-chain

ESP32S3 cluster running 1.58-bit (BitNet) Language model

7-node ESP32-S3 cluster running a 0.4B LLM via 1.58-bit (BitNet) ternary quantization over SPI daisy-chain - Low-Zi-Hong/ESP32s3-LLM-Cluster

140 points by nkko 23 days ago github.com 30 comments

Summary

A seven-node ESP32-S3 cluster demonstrates the use of a 0.4 billion parameter language model with innovative 1.58-bit ternary quantization. This setup showcases a unique daisy-chain configuration over SPI, highlighting efficient processing capabilities for low-resource environments.

Comments (30 of ) ⌛

Loading more comments... ⌛

Scroll down to load more comments

No comments available.