Tencent Releases and Open-Sources Tencent Hy4 Preview

Tencent has released and open-sourced Tencent Hy4 preview, a next-generation large language model with 770B total parameters and 49B active parameters, and a context window exceeding 1M tokens.
384 points by shenli3514 53 days ago www.tencent.com 250 comments

Summary

Tencent’s latest release, Hy4 preview, boasts an impressive 770 billion parameters and a context window that surpasses 1 million tokens. This open-source model aims to push the boundaries of large language models, offering new possibilities for developers and researchers.

Comments (250 of ) ⌛

Loading more comments... ⌛
Scroll down to load more comments
No comments available.
Type to search HN and engineering blog articles
Press Escape to close  |  ↑↓ to navigate  |  Enter to open