Show HN: Pulsys – Pull-through cache for Hugging Face built with io_uring
An open-source, authenticated pull-through cache for Hugging Face. - pulsys-io/pulsys
Summary not yet generated for this article.
Original Text
Pulsys is an open-source, self hosted, authenticated pull-through cache for Hugging Face. It acts as a drop-in replacement for existing HF clients and serves warm hits directly from disk, achieving up to 90 GB/s throughput (benchmarks are run on loopback on ec2) by bypassing standard syscalls in favor of io_uring (Linux) and sendfile (macOS).
Comments (1 of ) ⌛