Ask HN: Why don't we talk about context window size anymore?
Summary not yet generated for this article.
Original Text
Context length used to be one of the headline metrics for new models. I hardly hear about it anymore, but I can't imagine it doesn't still play a huge role in practical performance.
Is this truly no longer a bottleneck, or does it just get rolled up in the headline benchmark numbers now?
Comments (1 of ) ⌛