How I Made CosyVoice3 2.2× Faster on Apple Silicon
How I bounded PyTorch MPS memory growth, cut CosyVoice3 latency below real time, and moved only the dispatch-bound LLM stage to MLX.
Category archive
Field notes collected under Software Engineering.
How I bounded PyTorch MPS memory growth, cut CosyVoice3 latency below real time, and moved only the dispatch-bound LLM stage to MLX.
How I separated Codex and Pi from a growing Mattermost bridge, removed duplicated agent plumbing, and made each runtime replaceable without stopping routines.
Build a constrained KVM guest, run the AuthOS SQLite workload from the host, collect comparable results, and select a load for a longer test.
Fine-tune a 50M-parameter model on synthetic Kenyan ID OCR, measure field-level accuracy, and package the fused F16 weights for Candle inference in Rust.
A measured walkthrough of the modes, schema, synthetic fixture, and small understanding model I put around PP-OCRv6 to extract Kenyan ID fields locally.
How my Mattermost bridge keeps recurring schedules outside Codex, gives each run explicit state, and records the result without leaving an agent goal alive.
The architecture, bridge, and security boundary behind my self-hosted Mattermost interface to Codex on a local development machine.
I built a Flutter desktop UI for Perplexity's Bumblebee scanner to make scan scope, package inventory, exact exposure matches, diagnostics, and history easier to inspect.
How I built a Flutter client that keeps Jules sessions, approvals, and code diffs in one workspace, with account-scoped caching and visible sync state.
How Dream TTS separates its Flutter interface from Rust synthesis work so document imports, resumable jobs, model files, and private audio stay manageable.
A practical quality loop for local text-to-speech: representative fixtures, contextual normalization, useful latency metrics, defect labels, and release checks.
A practical design for keeping engine selection, sentence queues, playback, voice packages, and recovery behind one local speech service.