866ai

Aleph Alpha Releases Kolibri: A 78.1B Open-Weight English-German MoE Model With Only 3.46B Active Parameters

· 1 次浏览 ·来源: MarkTechPost
Aleph Alpha has released Kolibri , an open-weight Mixture-of-Experts (MoE) language model built for German and English. Kolibri has 78.1B total parameters but activates only 3.46B, or 4.4%, per token. It accepts up to 1,048,576 tokens of context, lets users set reasoning effort per request, and ships under the Apache 2.0 license on Hugging Face . The target is sovereign deployment in regulated sectors such as public administration, industry and aerospace. Is it deployable? Yes....

Aleph Alpha has released Kolibri , an open-weight Mixture-of-Experts (MoE) language model built for German and English. Kolibri has 78.1B total parameters but activates only 3.46B, or 4.4%, per token. It accepts up to 1,048,576 tokens of context, lets users set reasoning effort per request, and ships under the Apache 2.0 license on Hugging Face . The target is sovereign deployment in regulated sectors such as public administration, industry and aerospace. Is it deployable? Yes....

Aleph Alpha has released Kolibri , an open-weight Mixture-of-Experts (MoE) language model built for German and English. Kolibri has 78.1B total parameters but activates only 3.46B, or 4.4%, per token. It accepts up to 1,048,576 tokens of context, lets users set reasoning effort per request, and ships under the Apache 2.0 license on Hugging Face . The target is sovereign deployment in regulated sectors such as public administration, industry and aerospace. Is it deployable? Yes....