Providing SOCKS5 Forwarding with Dante
· β˜• 2 min read
Because the servers in the data center are bound to a small bandwidth, this post is mainly about using Dante to provide SOCKS5 forwarding, using some high-bandwidth servers for traffic forwarding to speed up dependency package downloads. 1. Find a High-Bandwidth Server Install speedtest-cli 1 pip3 install speedtest-cli List peer test servers 1 2 3 4 5 6 7 8 9 10 11 12 13 speedtest-cli --secure --list Retrieving speedtest.

Using Calico to Limit Pod Bandwidth
· β˜• 5 min read
1. Testing the Full Bandwidth Start the iperf3 server on the target host 1 2 3 4 5 iperf3 -s ----------------------------------------------------------- Server listening on 5201 ----------------------------------------------------------- Test from the client host 1 iperf3 -c x.x.x.x -p 5201 -t 10 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 Connecting to host x.

Distributed Computing Framework Ray
· β˜• 3 min read
1. What Ray Is In 2016, UC Berkeley’s RISELab released a new distributed computing framework called Ray. In 2017, after the Ray paper was published, it drew broad attention across the industry; in China it was mainly Ant Group that adopted and contributed to Ray. In 2020, Ray released version

Learning the Structure of Large Models Using Qwen as an Example
· β˜• 4 min read
1. Introduction to the Qwen Model In April 2023, Alibaba released the beta version of Qwen. In December 2023, Alibaba open-sourced the first version of Qwen. In September 2024, Alibaba released Qwen2.5. In January 2025, Alibaba released Qwen 2.5-Max. Qwen 2.5 is the latest series of the Qwen large language

NVIDIA Environment Variable Configuration
· β˜• 2 min read
NVIDIA_VISIBLE_DEVICES Specifies the GPU devices visible to the program 1 CUDA_VISIBLE_DEVICES=0,1 Available values: 1,2, a comma-separated list of GPU UUIDs or indices all, all GPUs none, load the driver but with no GPU access void, do not load the driver NVIDIA_DRIVER_CAPABILITIES Controls which driver libraries/binaries will be installed inside the container