Posts
JuiceFS Community Edition, Enterprise Edition, and Dragonfly Integration: Performance Testing and Comparison
· β˜• 11 min read
Note that --block-size 4096 in this post means 4GB; using --block-size 4 would be more reasonable and would give better write performance. 1. Environment Preparation Enter a safe directory 1 mkdir -p /data/test && cd /data/test All the test tasks are carried out in this directory. Create a separate directory for Redis 1 mkdir redis-data It is recommended to create a new directory, because Redis will change the Owner of the files in the current directory to systemd-coredump.

Pod Health Checks Drained /run Storage Space and Nearly Sent Me Packing
· β˜• 3 min read
If you use nvidia-container-runtime, this is worth your attention β€” especially if JuiceFS is also in the picture. 1. An Alert Out of Nowhere, and I Panicked Over the weekend I was studying TensorRT LLM, and while I was at it I installed Dragonfly on the largest production cluster. Then

Distributing Cluster Images with Dragonfly V2
· β˜• 10 min read
1. Introduction to Dragonfly The Dragonfly documentation at https://d7y.io/zh/docs/ already covers things in detail. Here is just a brief introduction to the main components of V2: Manager, which provides the UI, user management, cluster monitoring, task management, and other features Scheduler, which schedules traffic between Peers and provides preheating and other features Seed Peer, the back-to-source node used to download data from origin sites (Harbor, Docker.

Nydus Lazy-Loading Image Configuration and Practice
· β˜• 9 min read
Statistics show that most files inside a container are never used. Based on this characteristic, Nydus defines a custom filesystem in the Rafs format, enabling on-demand loading of image files to solve the slow startup and storage consumption caused by large images. In AI scenarios, whether for inference or training, images often start at several GB, or even tens of GB, so Nydus is very well suited.

The Increment Is No More, Chaos Shall Stand
· β˜• 10 min read
1. Only a Wheel Turning at High Speed Stays Balanced 1.1 The Consumer-Side Boom Is Over As of June 2023, China had 1.079 billion internet users, up 11.09 million from December 2022, with an internet penetration rate of 76.4%. The consumer-side demographic dividend has passed, time spent online is also growing slowly, and there is little room left for growth in applications built on existing scenarios.