1. What Is MCP MCP is short for Model Context Protocol, a protocol for passing context between models and applications. The greatest value of MCP is that, as the model wars are winding down and AI applications are about to explode, it gives developers a unified standard for invoking capabilities beyond the model itself.

In a PD disaggregated deployment, heterogeneous GPU models are often used to deploy the model across machines, which multiplies the cross-machine communication pressure. RDMA devices are usually brought in to accelerate kvcache transfer between nodes so as to achieve a lower FTTL. This post describes how to test eRDMA devices

1. Why Operations Events Less invasive Operations teams usually already have observations accumulated in the Metrics and Log dimensions. Operations events can be a new entry point: introduce new operational capabilities without affecting the stability of existing systems. Better suited to automation Metrics represent system state, Log represents specific code behavior, while Event represents changes in components.

1. Prompt Chaining Prompt chaining breaks a task down into a series of steps, where each LLM call processes the output of the previous step. 2. Routing Routing classifies the input and directs it to a specialized follow-up task. 3. Parallelization An LLM can sometimes work on a task concurrently and aggregate its outputs programmatically.

1. Handling Deterministic Faults For faults that have a specific handling procedure, just let the Agent handle them and send a notification to spread the word. For similar automated handling, we have exception load deletion at the application layer, disk cleanup at the node layer, masking an offline GPU card, masking a node, and so on.