All newsResearch

In voice models, the number in the name counts only the part that thinks

Published: 9/5/2026 · Source: Hugging Face — metadane plików wag (safetensors) i pliki config.json modeli głosowych

A text model called 8B holds about eight billion parameters. A voice model called 7B can hold ten and a half billion. We checked the published weight files of nine models and the gap turns out to be the rule, not an exception: the figure in the name describes the language backbone, while the encoder that hears and the head that speaks are simply not counted. The check is mechanical. Every model published on Hugging Face reports the exact size of its weight files, and the configuration file next to them shows what those weights are made of. Against a text control — Meta's Llama-3.1-8B-Instruct, which holds 8.03 billion parameters and is accurate to within half a percent — the voice models line up like this. Alibaba's Qwen2.5-Omni-7B holds 10.73 billion, fifty-three percent more than its name. Moonshot's Kimi-Audio-7B-Instruct holds 9.77 billion, forty percent more. LLaMA-Omni2-7B holds 8.95 billion. Qwen3-Omni-30B-A3B, downloaded more than eight hundred thousand times in the past month, holds 35.26 billion. Fun-Audio-Chat-8B, the model Alibaba opened in December and which we added to the catalogue today, holds 9.45 billion. What gets left out is always the same two organs. Fun-Audio-Chat's configuration file shows a text backbone with exactly the geometry of Qwen3-8B — thirty-six layers, 4096 hidden size, a vocabulary of 151936 tokens — accounting for 8.19 billion parameters. Above it sits an audio encoder of thirty-two layers, 1280 wide, twenty attention heads, reading 128 mel bands in thirty-second windows. That is, parameter for parameter, the shape of the Whisper-large encoder, and it reappears across vendors: the Ultravox project loads a component of identical geometry by name. Beside the backbone sits a third module, a speech head with the dimensions of Qwen3-0.6B, whose job is to emit sound. Roughly 1.25 billion parameters of ears and mouth, absent from the label. For a reader choosing hardware this is not trivia. In bfloat16, Llama-3.1-8B-Instruct occupies 15.0 GiB and fits on a 16 GB card. Qwen2.5-Omni-7B, whose name promises something smaller, occupies 20.0 GiB and does not. Qwen3-Omni-30B-A3B needs 65.7 GiB before a single second of audio is loaded. Fun-Audio-Chat's producer states the practical consequence plainly in its requirements: about 24 GB of GPU memory, and a second checkpoint downloaded separately if you want the model to speak rather than write. The naming is not dishonest everywhere. Microsoft's Phi-4-multimodal-instruct advertises 5.6 billion parameters and delivers 5.57 billion, and its card states in one sentence that the figure covers the Phi-4-Mini backbone plus the vision and speech encoders and adapters. It can be done. The error also runs the other way, which is the reason to check rather than to assume a direction. The repository fixie-ai/ultravox-v0_5-llama-3_1-8b has an eight in its name and contains 0.69 billion parameters — 1.3 GiB. The Llama backbone the name refers to is not inside; it is pulled separately at load time, and what ships is the hearing apparatus and the adapter. Downloading the file named after an 8B model gets you, in that case, everything except the 8B model.