How to Enable GDS on a GPU Host
· ☕ 8 min read
1. What GDS (GPUDirectStorage) Is GDS lets an RDMA NIC access GPU memory directly, which helps increase the IO bandwidth for GPU applications reading and writing files, reduces IO latency, and lowers their CPU load.
Once the client has GDS enabled, files are opened in O_DIRECT mode and the client no longer caches file data.