Same Request, Different Answer: Quantization Amplifies Cache-Induced Divergence in LLM Serving
arXiv:2609.04748v3 Announce Type: replace-cross Abstract: Major open-source serving stacks reuse the key-value tensors of a shared prefix by default. We measure…