Dispersion loss counteracts embedding condensation in small language models

Dispersion loss counteracts embedding condensation and improves generalization in small language models (ICML 2026).
32 points by E-Reverance 110 days ago chenliu-1996.github.io 7 comments
Summary not yet generated for this article.

Comments (7 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open