https://www.chenshaowen.com/en/tags/disaggregation/Recent content in Disaggregation on Shaowen Chen's WebsiteHugo -- gohugo.ioen©2016 - {year}, All Rights Reserved.Sat, 17 Jan 2026 00:00:00 +0000weeklyhttps://www.chenshaowen.com/en/blog/test-and-deploy-pd-disagg-app-with-erdma-on-aliyun.htmlSat, 17 Jan 2026 00:00:00 +0000Sat, 17 Jan 2026 00:00:00 +0000https://www.chenshaowen.com/en/blog/test-and-deploy-pd-disagg-app-with-erdma-on-aliyun.htmlIn a PD disaggregated deployment, heterogeneous GPU models are often used to deploy the model across machines, which multiplies the cross-machine communication pressure. RDMA devices are usually brought in to accelerate kvcache transfer between nodes so as to achieve a lower FTTL. This post describes how to test eRDMA devices微信公众号Alibaba CloudeRDMARDMAPDDisaggregationAIApplicationOperationshttps://www.chenshaowen.com/en/blog/using-vllm-to-deploy-pd-disagg-app.htmlSat, 20 Sep 2025 00:00:00 +0000Sat, 20 Sep 2025 00:00:00 +0000https://www.chenshaowen.com/en/blog/using-vllm-to-deploy-pd-disagg-app.html1. Why Deploy LLM Applications with PD Disaggregation In the process of LLM inference, there are two serial stages: Process the entire input context and generate the KV Cache (Prefill stage) Incrementally generate new tokens (Decode stage) These two stages have different resource requirements. The Prefill stage has to compute微信公众号vLLMDeploymentPDDisaggregationApplication