Show HN: Automatic deduction of FlashAttention kernel from ~25 lines of SQL
12 points by alxmrs
A demo showcases the automatic deduction of a FlashAttention kernel using approximately 25 lines of SQL, relying on three new SQL extensions. The xarray-sql library enables efficient representation of large array datasets as tables, ddx introduces automatic differentiation to standard SQL, and einfold serves as a modular query planner for FlashAttention. These tools aim to enhance SQL’s capabilities for handling complex data operations.