Inference Optimization for MiMo v2.5: Pushing Hybrid SWA Efficiency to the Limit

It's really cool and interesting to see the kind of engineering that goes into Xiaomi (and Deepseeks) inference optimizations. Z.ai has also published some interesting papers although I haven't had a chance to go through them yet.

It does inspire hope that the Chinese labs seem to be so open although the sceptic in me does wonder what their end game is.

Surely, from a purely economic perspective it would be wiser to keep this proprietary and benefit from the increased API traffic?

Will they lower the price or is this documenting past work

Such a well written article, refreshing to read in between all the slop.

I've used Mimo extensively in the past few months, can't wait to see what v3 will bring.