Tools · Updated 17 Oct, 05:55 am IST

vLLM publishes v0.32.0rc3 fixing NaN bug in Mamba2 kernel

Why it matters for readers: It’s a small but concrete example of how model-serving tooling is maintained and improved.

vLLM published release tag v0.32.0rc3 addressing a kernel bug.1
The update fixes NaN output from the Mamba2 chunk scan kernel on sm90.1
The commit is signed-off by Vadim Gimpelson and lists Claude (Anthropic) as co-author.1
The release entry includes two assets attached to the tag.1

Get a brief like this every morning

Uzha reads hundreds of sources and gives you the stories that matter for your work, with every source linked. Free.