GPU
SR-IOV Technology
· ☕ 3 min read
1. What SR-IOV Technology Is SR-IOV (Single Root I/O Virtualization) is a virtualization technology that lets virtual machines and containers access physical hardware resources directly, improving I/O performance and reducing host CPU consumption. As shown in the figure above, SR-IOV partitions a single physical device (for example a network interface

How to Enable GDS on a GPU Host
· ☕ 8 min read
1. What GDS (GPUDirectStorage) Is GDS lets an RDMA NIC access GPU memory directly, which helps increase the IO bandwidth for GPU applications reading and writing files, reduces IO latency, and lowers their CPU load. Once the client has GDS enabled, files are opened in O_DIRECT mode and the client no longer caches file data.

The Evolution of NVIDIA GPU Cores and Architectures
· ☕ 11 min read
1. Product Lines GeForce Aimed at gamers, offering powerful graphics processing capabilities and advanced gaming technologies. Common ones include the NVIDIA GTX series, the high-end RTX series, and the Titan series. Quadro Aimed at the professional market, such as designers, engineers, scientists, and content creators. Common ones include the Quadro P series and the high-end Quadro RTX series.

Common AI Base Images and Startup Commands
· ☕ 3 min read
1. What the Image Tag Suffixes Mean base/cuda: includes the CUDA runtime runtime: builds on base, adding the CUDA math libraries and the NCCL and cuDNN runtimes devel: builds on runtime, adding headers and the development tools used to build CUDA images; particularly useful for multi-stage builds cuddn: builds on the above, adding the cuDNN neural network acceleration library

Common GPU Operations and Fault Handling
· ☕ 18 min read
Content referenced or recorded while handling faults, continuously updated. 1. XID Error Events XID is NVIDIA’s error code. You can retrieve it with the command: 1 dmesg -T | grep -i "NVRM: Xid" or 1 journalctl --since `date -d "10 days ago" "+%Y-%m-%d"`|grep Xid The XID lets you locate the fault.