https://www.chenshaowen.com/en/tags/docker/Recent content in Docker on Shaowen Chen's WebsiteHugo -- gohugo.ioen©2016 - {year}, All Rights Reserved.Sun, 19 Apr 2026 00:00:00 +0000weeklyhttps://www.chenshaowen.com/en/blog/deploy-hermes-agent-under-containers.htmlSun, 19 Apr 2026 00:00:00 +0000Sun, 19 Apr 2026 00:00:00 +0000https://www.chenshaowen.com/en/blog/deploy-hermes-agent-under-containers.html1. Starting the Container Set the image 1 export IMAGE=nousresearch/hermes-agent:v2026.6.5 Set directory permissions 1 2 mkdir -p hermes-agent-home chmod -R 777 hermes-agent-home Set environment variables 1 2 3 cat <<EOF > hermes-agent-home/.env GATEWAY_ALLOW_ALL_USERS=true EOF Start hermes-agent 1 2 3 4 5 6 7 8 9 10 nerdctl run -d \微信公众号HermesAIContainersDockerOperationsAgenthttps://www.chenshaowen.com/en/blog/deploy-openclaw-under-containers.htmlWed, 04 Mar 2026 00:00:00 +0000Wed, 04 Mar 2026 00:00:00 +0000https://www.chenshaowen.com/en/blog/deploy-openclaw-under-containers.html1. Start the Container Set the image 1 export IMAGE=ghcr.io/openclaw/openclaw:2026.3.2 Generate a random token 1 openssl rand -hex 32 Set the gateway token 1 export OPENCLAW_GATEWAY_TOKEN=xxx This token is used for authentication on both the remote web UI and the local TUI. Set directory permissions 1 2 mkdir -p openclaw-home微信公众号OpenClawAIContainersDockerOperationsAgenthttps://www.chenshaowen.com/en/blog/deploy-deepseek-3fs-storage-system-under-containers.htmlSat, 15 Mar 2025 00:00:00 +0000Sat, 15 Mar 2025 00:00:00 +0000https://www.chenshaowen.com/en/blog/deploy-deepseek-3fs-storage-system-under-containers.html1. Deployment Plan Before starting the containerized deployment, a few requirements: To simplify delivery, only one image is needed For reliability, deploy as many replicas as possible Start different services through different parameters Inject configuration through environment variables and render it into configuration files Below is the deployment plan for DeepSeek 3FS:微信公众号StorageAIContainersKubernetesDockerOperationsLLM3FShttps://www.chenshaowen.com/en/blog/common-ai-base-images-and-run-command.htmlThu, 28 Mar 2024 00:01:00 +0000Thu, 28 Mar 2024 00:01:00 +0000https://www.chenshaowen.com/en/blog/common-ai-base-images-and-run-command.html1. What the Image Tag Suffixes Mean base/cuda: includes the CUDA runtime runtime: builds on base, adding the CUDA math libraries and the NCCL and cuDNN runtimes devel: builds on runtime, adding headers and the development tools used to build CUDA images; particularly useful for multi-stage builds cuddn: builds on the above, adding the cuDNN neural network acceleration library微信公众号AIImagesContainersDockerGPULLMOperationsR&Dhttps://www.chenshaowen.com/en/blog/nydus-configuration-and-practice.htmlSat, 06 Jan 2024 11:22:55 +0000Sat, 06 Jan 2024 11:22:55 +0000https://www.chenshaowen.com/en/blog/nydus-configuration-and-practice.htmlStatistics show that most files inside a container are never used. Based on this characteristic, Nydus defines a custom filesystem in the Rafs format, enabling on-demand loading of image files to solve the slow startup and storage consumption caused by large images. In AI scenarios, whether for inference or training, images often start at several GB, or even tens of GB, so Nydus is very well suited.微信公众号AINydusDockerImagesConfigurationPracticeOperationshttps://www.chenshaowen.com/en/blog/the-scope-of-credential-in-building.htmlThu, 06 Jul 2023 00:00:00 +0000Thu, 06 Jul 2023 00:00:00 +0000https://www.chenshaowen.com/en/blog/the-scope-of-credential-in-building.htmlIn the client, we have already seen the Docker CLI passing credentials to the Docker Daemon via X-Registry-Config when sending the build context. But recent build feedback still shows some phenomena that cannot be explained. This post mainly runs some basic tests to make troubleshooting easier. 1. Building under host Docker The Docker Daemon is started with root privileges.微信公众号CICDDevOpsDockerCredentialsKubernetesOperationsTroubleshootinghttps://www.chenshaowen.com/en/blog/troubleshoot-slow-io-when-building-dockerfile.htmlThu, 02 Feb 2023 00:00:00 +0000Thu, 02 Feb 2023 00:00:00 +0000https://www.chenshaowen.com/en/blog/troubleshoot-slow-io-when-building-dockerfile.html1. The Problem Project details: File size 5.6 GB File count 529352 Dockerfile 1 2 3 FROM golang:1.13 COPY ./ /go/src/code The build command and its output are as follows: 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 time DOCKER_BUILDKIT=1 docker build --no-cache -t test:v3 -f Dockerfile .微信公众号DockerImagesCICDBuildTroubleshootingOperationshttps://www.chenshaowen.com/en/blog/run-mv-is-slower-than-cp-in-dockerfile.htmlMon, 30 Jan 2023 00:00:00 +0000Mon, 30 Jan 2023 00:00:00 +0000https://www.chenshaowen.com/en/blog/run-mv-is-slower-than-cp-in-dockerfile.htmlUnlike on CentOS or Ubuntu, where we feel that mv is faster than cp, when you build an image with a Dockerfile, using Run cp is faster than Run mv. This post presents the test and verification data behind that. 1. Test Setup Machine environment Ubuntu 20.04.1 LTS 32C微信公众号DockerContainersCICDImagesOperationshttps://www.chenshaowen.com/en/blog/hijack-docker-io-req-to-private-repository.htmlMon, 18 Jul 2022 00:00:00 +0000Mon, 18 Jul 2022 00:00:00 +0000https://www.chenshaowen.com/en/blog/hijack-docker-io-req-to-private-repository.html1. Self-signing a *.docker.io Domain Certificate 1.1 Creating a CA Certificate Generate the CA certificate private key 1 openssl genrsa -out ca.key 4096 Generate the CA certificate 1 2 3 4 openssl req -x509 -new -nodes -sha512 -days 3650 \ -subj "/C=CN/ST=Beijing/L=Beijing/O=example/OU=Personal/CN=chenshaowen.com" \ -key ca.key \ -out ca.crt 1.2 Creating a *.微信公众号JenkinsKubernetesDockerImagesOperationsSecurityhttps://www.chenshaowen.com/en/blog/can-we-mount-var-lib-docker-to-remote-storage.htmlTue, 22 Jun 2021 00:00:00 +0000Tue, 22 Jun 2021 00:00:00 +0000https://www.chenshaowen.com/en/blog/can-we-mount-var-lib-docker-to-remote-storage.htmlNo. 1. Background When building a reliable, stable operations system on top of Kubernetes, destroying and creating virtual machines (VMs) is the norm. VMs provide compute and memory resources, while external storage is exposed to PVCs in the cluster through a StorageClass. Against this backdrop, how to initialize a VM quickly becomes a new challenge.微信公众号DockerContainersStorageKubernetesCan Wehttps://www.chenshaowen.com/en/blog/how-to-customize-your-jenkins.htmlSat, 05 Jun 2021 00:00:00 +0000Sat, 05 Jun 2021 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-customize-your-jenkins.html1. How to Deploy Jenkins To make the tests below easier, let me first introduce two ways to deploy Jenkins. Here I use the shaowenchen/jenkins:2.277.4 image. In a production environment, you should replace it with the official jenkins/jenkins image or your own custom image. 1.1 Running with docker-compose The docker-compose.yaml file微信公众号DevOpsCICDJenkinsDockerOperationshttps://www.chenshaowen.com/en/blog/how-to-run-a-private-registry-mirror.htmlThu, 29 Apr 2021 00:00:00 +0000Thu, 29 Apr 2021 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-run-a-private-registry-mirror.htmlA Docker mirror can only accelerate images from docker.io, not images from private registries. 1. Why You Need a Private Registry Mirror Rate limiting on the public network Docker Hub pull rate limits Reduce image pull time 2. Create a Registry Image Acceleration Service Generate a configuration file version: 0.微信公众号DockerContainersImagesOperationsRegistryAccelerationhttps://www.chenshaowen.com/en/blog/how-to-distribute-files-and-scripts-to-vm-under-kubernetes.htmlSat, 24 Apr 2021 00:00:00 +0000Sat, 24 Apr 2021 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-distribute-files-and-scripts-to-vm-under-kubernetes.html1. What This Article Mainly Discusses Never build a high tower on shifting sand. Business growth and the evolution of business forms both need solid, powerful IT systems to support them. Business content is transparent to the market, but IT systems cannot be built to perfection overnight. In the future, competition between companies will mainly come from competition between their IT systems, and the ability to respond quickly to business requirements will be the key to winning.微信公众号KubernetesDockerPaaSOperationsConfiguration ManagementVirtual MachinesLearningCloud Nativehttps://www.chenshaowen.com/en/blog/using-podman-to-build-images-under-kubernetes-and-jenkins.htmlThu, 25 Feb 2021 00:00:00 +0000Thu, 25 Feb 2021 00:00:00 +0000https://www.chenshaowen.com/en/blog/using-podman-to-build-images-under-kubernetes-and-jenkins.htmlIn principle, Jenkins can use Podman to build images in any Kubernetes cluster; this article uses Containerd as the example. 1. Dropping Docker Brings New Challenges to CICD In CICD scenarios, we often need to build and push images within a pipeline. In an earlier document, Creating Jenkins Slaves Dynamically on Kubernetes, I described how mounting the /var/run/docker.微信公众号JenkinsDevOpsCICDDockerKubernetesPodmanhttps://www.chenshaowen.com/en/blog/attack-vectors-under-kubernetes.htmlFri, 22 Jan 2021 00:00:00 +0000Fri, 22 Jan 2021 00:00:00 +0000https://www.chenshaowen.com/en/blog/attack-vectors-under-kubernetes.htmlThis document is mainly meant to demonstrate the dangers of Docker privileged mode, so please proceed with caution. Users without CLI access can copy the example YAML and directly create cluster workloads such as Pod, Job, and DaemonSet to carry out the operations. 1. Directly Deleting All Resources If you can log in to the machine, pack your things, and run the command:微信公众号KubernetesSecurityAttack VectorsOperationsDockerTroubleshootinghttps://www.chenshaowen.com/en/blog/operate-host-in-container-and-debug-container-on-host.htmlMon, 11 Jan 2021 00:00:00 +0000Mon, 11 Jan 2021 00:00:00 +0000https://www.chenshaowen.com/en/blog/operate-host-in-container-and-debug-container-on-host.html1. A Strange Requirement My boss had a strange requirement: use a single kubeconfig file to fetch all kinds of host status information, such as the process list and process states. My first reaction was that he must not understand containers — how could anyone use them that way, and if you were going to use them that way, why use containers at all?微信公众号ContainersSecurityKubernetesDockerOperationshttps://www.chenshaowen.com/en/blog/how-to-cross-the-limit-of-dockerhub.htmlWed, 09 Dec 2020 00:00:00 +0000Wed, 09 Dec 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-cross-the-limit-of-dockerhub.html1. DockerHub Limits In the end, there is no getting around this error: 1 Error response from daemon: toomanyrequests: You have reached your pull rate limit. You may increase the limit by authenticating and upgrading: https://www.docker.com/increase-rate-limit Starting November 2, 2020, DockerHub officially began limiting the pull rate for non-paying users:微信公众号DockerImagesDockerHubOperationsTroubleshootingRate LimitingProxyhttps://www.chenshaowen.com/en/blog/how-to-use-docker-in-docker.htmlSat, 21 Nov 2020 00:00:00 +0000Sat, 21 Nov 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-use-docker-in-docker.html1. Typical Use Cases In CI, there is usually a CI Engine responsible for parsing the pipeline and controlling the whole build process, while the actual build is delegated to an Agent. Jenkins and GitLab both work this way. As shown below, there are many kinds of Agents that connect to the CI Engine.微信公众号DockerKubernetesContainersCICICDOperationsLearningDinDBuildJenkinshttps://www.chenshaowen.com/en/blog/deploy-static-server-by-docker-image.htmlWed, 16 Sep 2020 00:00:00 +0000Wed, 16 Sep 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/deploy-static-server-by-docker-image.html1. Why Deploy Independently with an Image Better SEO With GitHub Pages, deploying a static site is very convenient. Configure it once, and every commit deploys and updates automatically. Add jsDelivr and Cloudflare acceleration on top, and among free options it is already production-ready. Unfortunately, Baidu’s search engine indexes GitHub Pages sites very slowly, or not at all.微信公众号HexoDockerImagesBlogOperationshttps://www.chenshaowen.com/en/blog/docker-image-under-multi-arch.htmlSun, 05 Jul 2020 00:00:00 +0000Sun, 05 Jul 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/docker-image-under-multi-arch.html1. Enabling Docker’s experimental Feature First, enable Docker’s experimental feature, so the commands below are available. Edit vim ~/.docker/config.json and add the following: 1 2 3 4 { "experimental": "enabled", "debug": true } Note that this is not the /etc/docker/daemon.json file, and Docker does not need to be restarted. 2. Docker Images Starting with Docker 1.微信公众号DockerImagesMulti-ArchmanifestOperationshttps://www.chenshaowen.com/en/blog/how-to-install-gpu-driver-in-centos.htmlSat, 15 Feb 2020 00:00:00 +0000Sat, 15 Feb 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-install-gpu-driver-in-centos.htmlUsing CentOS 7.7 and a Tesla P100 GPU as an example. 1. Preparing the Base Environment Install the lspci command 1 yum install -y pciutils Check whether the GPU supports CUDA 1 2 3 lspci | grep -i nvidia 00:09.0 3D controller: NVIDIA Corporation GP100GL [Tesla P100 PCIe 12GB] (rev a1) List of CUDA-capable GPUs: https://developer.微信公众号DockerGPUCentOSOperationsDrivershttps://www.chenshaowen.com/en/blog/using-s2i-to-build-cloud-native-applications.htmlMon, 26 Aug 2019 00:00:00 +0000Mon, 26 Aug 2019 00:00:00 +0000https://www.chenshaowen.com/en/blog/using-s2i-to-build-cloud-native-applications.html1. What Problem S2I Solves It is foreseeable that a large number of applications will be deployed as containers in the future. Container platforms care about images and containers, while application development cares about business code, and ultimately the code needs to be deployed as an image. From code to image — that is Source To Image, or S2I.微信公众号S2IDockerCloud NativeImagesOperationsR&Dhttps://www.chenshaowen.com/en/blog/how-to-use-jenkins-docker-gitlab-to-build-django-automated-deployment-process.htmlSun, 25 Nov 2018 00:00:00 +0000Sun, 25 Nov 2018 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-use-jenkins-docker-gitlab-to-build-django-automated-deployment-process.htmlOne of the illusions that programmers at big companies easily fall into is mistaking platform capabilities for their own abilities. In a large team, we should not focus only on our own little patch of ground; we need to understand every part of the platform. On one hand, this helps us make better use of the platform’s features; on the other, it helps our own technical growth.微信公众号DjangoGitLabJenkinsDockerDevOpsCICDR&DOperationshttps://www.chenshaowen.com/en/blog/docker-operations-practices.htmlSat, 24 Nov 2018 00:00:00 +0000Sat, 24 Nov 2018 00:00:00 +0000https://www.chenshaowen.com/en/blog/docker-operations-practices.htmlCompiled from the “Development Tips” series, a roundup of common problems and solutions in Docker usage and operations. 1. Basic Docker Machine Commands Create the my-vm-name virtual machine 1 docker-machine create --driver virtualbox my-vm-name List all docker-machine instances 1 2 3 4 docker-machine ls NAME ACTIVE DRIVER STATE URL SWARM微信公众号DockerOperationsR&DContainershttps://www.chenshaowen.com/en/blog/centos-server-operations-practices.htmlSun, 11 Nov 2018 00:00:00 +0000Sun, 11 Nov 2018 00:00:00 +0000https://www.chenshaowen.com/en/blog/centos-server-operations-practices.htmlCompiled from the “Development Tips” series, collecting common problems and solutions in CentOS server operations. 1. Upgrading the Docker Version Uninstall the old version of Docker 1 2 3 4 5 6 $yum remove docker \ docker-common \ container-selinux \ docker-selinux \ docker-engine \ docker-engine-selinux Images, containers, data, and networks stored in /var/lib/docker/ are all preserved.微信公众号CentOSLinuxOperationsR&DDockerhttps://www.chenshaowen.com/en/blog/how-to-use-minikube-under-windows7.htmlSun, 23 Sep 2018 00:00:00 +0000Sun, 23 Sep 2018 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-use-minikube-under-windows7.html1. Basic Concepts 1.1 Kubernetes Kubernetes (K8s for short), the successor to Google’s Borg, is an open-source system for automatically deploying, scaling, and managing containerized applications. The features it provides: Automated deployment of containers Automated scaling up and down Automated application/service upgrades Grouping containers to serve traffic externally, with load balancing support Health checks for services, with automatic restarts 1.微信公众号DockerKubernetesWindowsMiniKubeLearningOperationshttps://www.chenshaowen.com/en/blog/how-to-package-a-docker-image-of-robot-framework.htmlTue, 18 Sep 2018 00:00:00 +0000Tue, 18 Sep 2018 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-package-a-docker-image-of-robot-framework.htmlTo make it easier for CI to integrate UI automation tests, the Robot Framework runtime needs to be packaged as a Docker image. This post covers the configuration and scripts involved in the packaging process. 1. Packaging Directory Structure 1 2 3 4 5 6 tree . ├──微信公众号DockerRobotFrameworkPythonTestingCICDOperationshttps://www.chenshaowen.com/en/blog/how-to-package-django-development-environments-using-docker-6.htmlSun, 24 Sep 2017 18:03:22 +0000Sun, 24 Sep 2017 18:03:22 +0000https://www.chenshaowen.com/en/blog/how-to-package-django-development-environments-using-docker-6.html1. Directory Structure The django-devops-uwsgi directory holds the image build files that package uWSGI and Django. It installs the necessary packages such as uWSGI, pip, and virtualenv into the image. When a container is created from the image, the start.sh script runs: it creates the Python virtual runtime environment, installs the dependency packages from Django’s requirements.微信公众号DockerDjangoPythonServicesToolsR&DOperationshttps://www.chenshaowen.com/en/blog/how-to-package-django-development-environments-using-docker-5.htmlSun, 24 Sep 2017 14:34:35 +0000Sun, 24 Sep 2017 14:34:35 +0000https://www.chenshaowen.com/en/blog/how-to-package-django-development-environments-using-docker-5.html1. Directory Structure 1 2 3 4 5 6 7 8 9 10 11 12 ├── django-devops-nginx │ ├── Dockerfile │ └── nginx.repo ├── django-devops-compose │ ├── docker-compose.yml │ ├── www │ ├── conf │ │ ├── nginx.conf │ ├── log │ │ ├── nginx │ │ │ ├── access.log │ │ │ ├── error.微信公众号DockerServicesToolsDjangoNginxPythonR&DOperationshttps://www.chenshaowen.com/en/blog/how-to-package-django-development-environments-using-docker-3.htmlSat, 23 Sep 2017 19:56:03 +0000Sat, 23 Sep 2017 19:56:03 +0000https://www.chenshaowen.com/en/blog/how-to-package-django-development-environments-using-docker-3.html1. Basic Concepts Docker Compose is a Docker tool for defining and running complex applications. With Docker Compose, you can define a multi-container application in a single file, then use a single command to start your application and finish all the preparation work. Docker Compose positions itself as ‘defining and running complex applications with Docker’.微信公众号DockerServicesToolsDjangoPythonR&DOperationshttps://www.chenshaowen.com/en/blog/how-to-package-django-development-environments-using-docker-2.htmlFri, 22 Sep 2017 19:52:27 +0000Fri, 22 Sep 2017 19:52:27 +0000https://www.chenshaowen.com/en/blog/how-to-package-django-development-environments-using-docker-2.html1. Basic Concepts A Dockerfile is a collection of instructions for building a Docker image. Docker reads Dockerfile instructions to build an image automatically. A Dockerfile is similar to a Makefile: both are text files that organize all the instructions in the order the image is built. The command to build a Docker image:微信公众号DockerDjangoPythonServicesToolsR&DOperationshttps://www.chenshaowen.com/en/blog/django-application-performance-test-based-on-docker.htmlThu, 07 Sep 2017 19:08:09 +0000Thu, 07 Sep 2017 19:08:09 +0000https://www.chenshaowen.com/en/blog/django-application-performance-test-based-on-docker.html1. Basic Website Performance Metrics Concurrency: the number of sessions the server handles per unit of time Throughput: the number of requests the server handles per unit of time Response time: the total elapsed time from when the user sends a request to when the response is fully received, made up of network transmission time, service processing time, and other parts Average response time: the average of the response times of all requests 2.微信公众号TestingDemoDockerDjangohttps://www.chenshaowen.com/en/blog/basis-of-docker.htmlFri, 28 Jul 2017 15:30:00 +0000Fri, 28 Jul 2017 15:30:00 +0000https://www.chenshaowen.com/en/blog/basis-of-docker.html1. What Docker Is Docker was born in early 2013 as a side project inside dotCloud (the former name of Docker Inc.). Its source code is hosted on GitHub, it is written in Go, and it follows the Apache 2.0 open-source license. The goal of the Docker project is to provide a lightweight operating system virtualization solution.微信公众号PaaSDevOpsDockerContainersLearning