1. Storage Tiering and Interconnect 2. Various Storage Types Storage Type Bandwidth Capacity Response Latency Cost per Unit of Storage Storage Principle Use Case CPU L1 Cache 256-512GB/s 32-64KB/core <1ns ~$2000/MB SRAM Closest cache layer to CPU core CPU L2 Cache 64-256GB/s 256KB-2MB/core group 2-5ns ~$1000/MB Partly SRAM, partly embedded DRAM Next-level cache for the CPU CPU L3 Cache 32-128GB/s 4-16MB/CPU 5-15ns ~$100-200/MB Embedded DRAM Last-level cache for the CPU GPU L1 Cache 8-32TB/s 16-96KB/SM <1ns ~$2000/MB SRAM Closest cache layer to GPU core GPU L2 Cache 1-4TB/s 512KB-4MB/SMC 5-15ns ~$500-1000/MB Partly SRAM, partly embedded DRAM Next-level cache for the GPU Main memory (RAM) 10-80GB/s 4-128GB 30-60ns ~$2-7/GB DDR4/5 DRAM System main storage space GPU VRAM 768GB/s-4TB/s 4-24GB 25-75ns ~$7-20/GB GDDR6/6X SDRAM Dedicated high-speed buffer storage for the GPU SSD 500MB/s-7000MB/s 128GB-8TB 0.

1. Storage Options There are three storage approaches: Isolate by directory and share a single JuiceFS Elasticsearch nodes share one JuiceFS instance, mounting different Elasticsearch nodes through subdirectories. /0/ corresponds to node Node-0 /1/ corresponds to node Node-1 /2/ corresponds to node Node-2 The main advantage of this approach is that it is easy to scale and simple to configure.

1. Create the Dataset 1 2 3 4 5 6 7 8 9 10 kubectl apply -f - <<EOF apiVersion: v1 kind: Secret metadata: name: my-s3 type: Opaque stringData: aws.accessKeyId: xxx aws.secretKey: xxx EOF 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 kubectl apply -f - <<EOF apiVersion: data.

1. Packaging the Fluid Runtime Image Create the fluid_config_init.py script 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 #!/usr/bin/env python import json rawStr = "" with open("/etc/fluid/config.json", "r") as f: rawStr = f.

1. Creating a Dataset 1 2 3 4 5 6 7 8 9 10 kubectl apply -f - <<EOF apiVersion: data.fluid.io/v1alpha1 kind: Dataset metadata: name: nfs-demo spec: mounts: - mountPoint: x.x.x.x:/x-x/ name: nfs-demo EOF 2. Creating a Runtime 1 2 3 4 5 6 7 8 9 10 11 12 13 14 kubectl apply -f - <<EOF apiVersion: data.