What would you do if you have AI software that may be transformers alternative?

3 points by adinhitlore 213 days ago 5 comments
Summary not yet generated for this article.

Original Text

Assuming your software meets some of these:

* Better than potential successors of SOTA transformers: Mamba, Hyenna, RWKV, xLSTM; * Gemini/claude estimate potential ip values in the millions; * All implemented in C (ok this may be a minus) but also ported to C# and F# - so no python nor rust; * humble code size: 10-15k lines of code but i mean come on gpt-1 was under 1000 lines...in python.

In short:

the problem: transformers are slow and could be smarter; solution: you have fast and smart alternative. 10x!

Comments (5 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open