AI
MPI Communication Primitives and Their Use in Python Programming
· β˜• 3 min read
1. What MPI Is MPI, the Message Passing Interface, is a communication protocol used for parallel computing. MPI provides a set of standardized interfaces for transferring data between different compute nodes, and is widely used in scientific computing, machine learning, deep learning, and other fields. MPI has multiple implementations; the

Several Common Network Topology Structures
· β˜• 3 min read
1. Fat-Tree In 1985, Charles E. Leiserson of MIT invented the Fat-Tree network. As shown in the figure below, a fat-tree network is a binary tree in which bandwidth gradually increases from the root nodes down to the leaf nodes. In August 2008, a group of computer scientists at UC San Diego published a scalable network architecture design that adopted a topology inspired by the fat-tree topology, achieving better scalability than previous hierarchical networks.

RDMA Technology
· β˜• 6 min read
1. What RDMA Is RDMA (Remote Direct Memory Access) is a technology created to solve the delay of server-side data processing in network transmission. With TCP/IP transmission, data passes through the network stack, then through the NIC to be sent; after the receiver receives it, the data is reassembled according to sequence numbers.

Using Fluid to Access OBS Storage and Performance Testing
· β˜• 2 min read
1. Jindo Mounting OBS Set the environment variables 1 2 3 4 export ENDPOINT=obs.cn-north-4.myhuaweicloud.com export BUCKET= export AK= export SK= Create the credentials 1 2 3 4 5 6 7 8 9 10 kubectl apply -f - <<EOF apiVersion: v1 kind: Secret metadata: name: myobssecret type: Opaque stringData: fs.obs.accessKeyId: ${AK} fs.

How to Enable GDS on a GPU Host
· β˜• 8 min read
1. What GDS (GPUDirectStorage) Is GDS lets an RDMA NIC access GPU memory directly, which helps increase the IO bandwidth for GPU applications reading and writing files, reduces IO latency, and lowers their CPU load. Once the client has GDS enabled, files are opened in O_DIRECT mode and the client no longer caches file data.