1. Creating a Dataset

 1
 2
 3
 4
 5
 6
 7
 8
 9
10

kubectl apply -f - <<EOF
apiVersion: data.fluid.io/v1alpha1
kind: Dataset
metadata:
  name: nfs-demo
spec:
  mounts:
  - mountPoint: x.x.x.x:/x-x/
    name: nfs-demo
EOF

2. Creating a Runtime

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14

kubectl apply -f - <<EOF
apiVersion: data.fluid.io/v1alpha1
kind: ThinRuntimeProfile
metadata:
  name: nfs
spec:
  fileSystemType: nfs
  fuse:
    image: fluidcloudnative/nfs
    imageTag: v0.1
    imagePullPolicy: IfNotPresent
    command:
      - "/usr/local/bin/entrypoint.sh"
EOF

1
2
3
4
5
6
7
8

kubectl apply -f - <<EOF
apiVersion: data.fluid.io/v1alpha1
kind: ThinRuntime
metadata:
  name: nfs-demo
spec:
  profileName: nfs
EOF

3. Creating a Test Pod

 1
 2
 3
 4
 5
 6
 7
 8
 9
10
11
12
13
14
15
16
17

kubectl apply -f - <<EOF
apiVersion: v1
kind: Pod
metadata:
  name: nfs-demo
spec:
  containers:
    - name: nfs-demo
      image: shaowenchen/demo:ubuntu
      volumeMounts:
        - mountPath: /data
          name: nfs-demo
  volumes:
    - name: nfs-demo
      persistentVolumeClaim:
        claimName: nfs-demo
EOF

4. Performance Testing

4.1 Testing Tools

• Install the Opscli tool

1

curl -sfL https://raw.githubusercontent.com/shaowenchen/ops/main/getcli.sh | VERSION=latest sh -

• Test command

1

opscli task --filepath  ~/.ops/tasks/get-diskio-byfio.yaml --filename ./testfile --size 10g -i 127.0.0.1

4.2 Three Ways to Mount NFS

1. Direct — mount straight onto a host directory

1

mount -t nfs x.x.x.x:/x-x/ /data/

2. Use CSI-Driver-NFS to provide NFS storage

See https://github.com/kubernetes-csi/csi-driver-nfs

3. Use Fluid NFS Runtime to provide NFS storage

4.3 Test Results — 10 GB of Data

• Random Read Testing

• Random Write Testing

• Sequential Read Testing

• Sequential Write Testing

• Random Read IOPS Testing

• Random Write IOPS Testing

4.4 Test Results — 1 GB of Data

• Random Read Testing

• Random Write Testing

• Sequential Read Testing

• Sequential Write Testing

• Random Read IOPS Testing

• Random Write IOPS Testing

4.5 Test Results — 100 MB of Data

Okay, I will organize all the test cases according to the format you provided.

• Rand_Read_Testing

• Rand_Write_Testing

• Sequ_Read_Testing

• Sequ_Write_Testing

• Rand_Read_IOPS_Testing

• Rand_Write_IOPS_Testing

• Rand_Read_Latency_Testing

• Rand_Write_Latency_Testing

4.5 Conclusion

• Direct

Mounting NFS directly gives the best performance, but under Kubernetes it can only be mounted via HostPath, which makes it inconvenient to use.

• CSI NFS Pod

Its read/write performance on small files is very good, making it suitable for scenarios such as storing code, but its advantage over the other approaches is not obvious.

• Fluid NFS Pod

The NFS performance provided by Fluid Runtime is not far off from a direct mount, because the Fuse Pod works by mounting the NFS directory onto the current host directory.