https://www.chenshaowen.com/en/tags/lmcache/Recent content in lmcache on Shaowen Chen's WebsiteHugo -- gohugo.ioen©2016 - {year}, All Rights Reserved.Wed, 17 Sep 2025 00:00:00 +0000weeklyhttps://www.chenshaowen.com/en/blog/use-lmcache-to-improve-ttft.htmlWed, 17 Sep 2025 00:00:00 +0000Wed, 17 Sep 2025 00:00:00 +0000https://www.chenshaowen.com/en/blog/use-lmcache-to-improve-ttft.html1. Introduction to LMCache TTFT is the time from when a request is issued until the model generates its first token. Because the Prefill phase has to encode the input context into a KV Cache before generation can begin, producing that first token requires a large amount of computation, which makes TTFT high.微信公众号AILLMvLLMInferencelmcacheOperations