Taking the 2B Qwen3-TTS from 0.876 RTF to 0.253 RTF on Apple Silicon M4
A day of profiling a two-billion-parameter speech model on an M4 MacBook Pro, told as six wrong predictions. The largest win was nine lines of sorting, and one of my two …
Tag archive
#Metal
Notes connected by the Metal tag.
2
entries
→
Tuning CosyVoice3 in Rust: Where the Speed Actually Was
The same speech model made fast a second time, in Rust on Metal, from RTF 2.96 to 0.697. Scheduling beat kernels, and two of the measurements I steered by were wrong.
No entries are filed here yet.
Browse all notes →