1. What SR-IOV Technology Is SR-IOV (Single Root I/O Virtualization) is a virtualization technology that lets virtual machines and containers access physical hardware resources directly, improving I/O performance and reducing host CPU consumption. As shown in the figure above, SR-IOV partitions a single physical device (for example a network interface

1. What GDS (GPUDirectStorage) Is GDS lets an RDMA NIC access GPU memory directly, which helps increase the IO bandwidth for GPU applications reading and writing files, reduces IO latency, and lowers their CPU load. Once the client has GDS enabled, files are opened in O_DIRECT mode and the client no longer caches file data.

1. Product Lines GeForce Aimed at gamers, offering powerful graphics processing capabilities and advanced gaming technologies. Common ones include the NVIDIA GTX series, the high-end RTX series, and the Titan series. Quadro Aimed at the professional market, such as designers, engineers, scientists, and content creators. Common ones include the Quadro P series and the high-end Quadro RTX series.

1. Data Parallelism Training steps: The master device loads the model and copies the model parameters to every worker device The master device splits the training data along the batch dimension and passes each batch to every worker device Each worker device performs training The master device aggregates the gradients from each worker device and updates the model parameters The master device broadcasts the model parameters to every worker device, preparing for the next batch of training Core idea:

1. What the Image Tag Suffixes Mean base/cuda: includes the CUDA runtime runtime: builds on base, adding the CUDA math libraries and the NCCL and cuDNN runtimes devel: builds on runtime, adding headers and the development tools used to build CUDA images; particularly useful for multi-stage builds cuddn: builds on the above, adding the cuDNN neural network acceleration library