Posts
Using TensorBoard to Visualize the PyTorch Training Process
· β˜• 7 min read
1. What TensorBoard Is TensorBoard is mainly used to monitor how a model’s various metrics change β€” accuracy, loss, the weight distributions of each layer, and so on. TensorBoard is a visualization tool from TensorFlow that supports visualizing scalar, text, image, audio, video, and embedding data, among other types. But PyTorch can use TensorBoard too.

Training a Model on the MNIST Dataset with PyTorch
· β˜• 3 min read
1. Create the Training Script Create a training script mnist.py with the following contents: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36

Switch to a Specific Kernel Version on Ubuntu
· β˜• 3 min read
1. Installing a New Kernel Version Installing from the apt repositories is recommended, so you avoid installing an incompatible kernel version. 1.1 Installing from the Repository List the available versions 1 2 3 4 apt list linux-headers-5.15.*-*-generic linux-image-5.15.*-*-generic linux-image-5.15.0-94-generic/focal-updates,focal-security 5.15.0-94.104~20.04.1 amd64 linux-image-5.15.0-97-generic/focal-updates,focal-security 5.15.0-97.107~20.04.1 amd64 Install the kernel 1 apt install linux-image-5.

MPI Communication Primitives and Their Use in Python Programming
· β˜• 3 min read
1. What MPI Is MPI, the Message Passing Interface, is a communication protocol used for parallel computing. MPI provides a set of standardized interfaces for transferring data between different compute nodes, and is widely used in scientific computing, machine learning, deep learning, and other fields. MPI has multiple implementations; the

Ops v1.0.0 Released
· β˜• 2 min read
Based on real production needs, I recently made several important updates to https://github.com/shaowenchen/ops and released version v1.0.0. Here I mainly introduce the key features of this release. 1. Support for Multi-Cluster Task Execution In practice, the recommendation is: Create the hosts of the current cluster as Hosts You can create multiple Clusters, and the Cluster objects you own are the clusters under management Task and Pipeline objects are automatically synchronized to all Clusters under the cluster, with no manual trigger required.