Two RTX 5090 hosts sharing a KV cache over Ethernet

4 points by velmu

Read the article

Discussion on Hacker News