Hours of YouTube and 85 handtyped pages of notes on LLM Inference – Start here
32 points by samirswr
A small LLM inference engine has been developed using insights gained from over six hours of YouTube tutorials and 85 pages of handwritten notes. The project, labeled samir-sarwar/samir-vllm, aims to provide a foundational understanding and practical implementation of LLM inference techniques.