A new speech-to-text model called Whistle, with a size of 16.9 MB, has been released.

What it means

Whistle is a newly released open speech-to-text model from Cactus Compute that fits in a single 16.9 MB file (about 55M parameters, 36M active, CQ2-bit quantized). It is designed to run offline on ordinary CPUs, transcribes seven languages, and can be paired with Cactus Compute's Needle engine to turn audio directly into tool-call requests. The practical claim is that you can do on-device speech recognition without a GPU or cloud connection, at the cost of some accuracy relative to much larger models.

Accuracy & sourcesGrounded

The model's existence, size, and parameter count are consistently reported across multiple independent hands-on write-ups (Reddit, dev.to, Medium) and appear grounded in Cactus Compute's own release, so the core size/capability claim is solid. Quality claims are more contested: one Hacker News comment reports noticeably worse transcriptions than a much larger Qwen-ASR model on 170 messages, so 'runs on CPU' is credible but 'accurate enough' likely depends on the use case.

How new

Genuinely new: this coverage appeared in the October 8-11, 2026 window, shortly after the model's release.

Go deeper