Baidu dropped ERNIE 5.5 Flash Base

81 points by pretext

Baidu has launched ERNIE 5.5 Flash Base, a hybrid-attention model featuring 280 billion parameters and 14 billion active neurons, which has been pretrained on 33.5 trillion tokens. This model emphasizes openness and efficiency in its pretraining approach.

Read the article

Discussion on Hacker News