Tuning CosyVoice3 in Rust: Where the Speed Actually Was

Wed, 05 Aug 2026 08:30:00 +0300

I spent two rounds of work optimising a stage that accounts for 4.4% of runtime, because my own profiler told me it was 17%.

That is the most useful thing I can tell you about this project, so it goes first. The rest — RTF 2.96 down to 0.697 on the same 132-word passage, a second implementation of a model I had already made fast once in PyTorch, this time in Rust on candle — is downstream of getting the instrument right.

Profiling on DRM HSE

Tuning CosyVoice3 in Rust: Where the Speed Actually Was