kernelspace — systems programming for LLM serving

Show HN: Kernelspace- interactive course on systems programming for LLM Serving

From cache lines to continuous batching. The interactive course for backend engineers. No prior systems knowledge required.

2 points by praveer13 71 days ago kernelspace.naigap.com 0 comments

Summary not yet generated for this article.

Original Text

Hi HN,

*I* built kernelspace - a free and interactive course that takes a backend engineer (like me) with java/python experience to the systems level required to work on LLM serving at scale. (Mostly an attempt for me to understand what everyone's talking about lately and also an attempt at staying up to date to current tech - career wise).

It has: 1. 68 Lessons across 9 tracks, with a rust-from-zero ramp. 2. 8 rust labs - BPE tokenizer, KV block manager, radix cache, batching scheduler, a toy executor 3. 9 simulators running in browser (wasm) - roofline model, KV cache pressure, continuous batching dynamics 4. Fleet week - a simulated prod serving fleet

All progresss is local - there is no server (it's served from github pages, repo here https://github.com/praveer13/kernelspace)

Feedback appreciated, and contributions welcome. I want to make this a really good course for me (and everyone else like me).

Original Text

Comments (0 of ) ⌛