cold starts

TurboQuant, Fast Cold Starts, and Rust on GPUs

TurboQuant cuts KV cache use 4.6x, GPU state restoration slashes cold starts, and Rust is moving deeper into CUDA work.