https://www.chenshaowen.com/en/tags/ci/Recent content in CI on Shaowen Chen's WebsiteHugo -- gohugo.ioen©2016 - {year}, All Rights Reserved.Fri, 17 Jan 2025 00:00:00 +0000weeklyhttps://www.chenshaowen.com/en/blog/use-nerdctl-to-build-multi-architecture-images.htmlFri, 17 Jan 2025 00:00:00 +0000Fri, 17 Jan 2025 00:00:00 +0000https://www.chenshaowen.com/en/blog/use-nerdctl-to-build-multi-architecture-images.html1. Installing Nerdctl Install Opscli 1 curl -sfL https://raw.githubusercontent.com/shaowenchen/ops/main/getcli.sh |VERSION=latest sh - Install Nerdctl 1 opscli task -f install-nerdctl --arch amd64 2. BuildKit Download Buildkit 1 wget https://github.com/moby/buildkit/releases/download/v0.19.0-rc2/buildkit-v0.19.0-rc2.linux-amd64.tar.gz Install Buildkit 1 2 tar xvf buildkit-*.tar.gz mv bin/* /usr/local/bin/ Configure Buildkitd 1 mkdir -p /etc/buildkit /data/buildkit 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 cat > /etc/buildkit/buildkitd.微信公众号Multi-ArchImagesCINerdctlKubernetesOperationsLearningCICDcontainerdBuildhttps://www.chenshaowen.com/en/blog/how-to-cache-third-party-package-whilie-building-in-stage.htmlTue, 22 Feb 2022 00:00:00 +0000Tue, 22 Feb 2022 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-cache-third-party-package-whilie-building-in-stage.htmlIn a non-staged build scenario, when we use a container to build, we can mount the cache directory inside the container onto the build host, run the build task, and then copy the artifacts into the runtime image to produce the application image. But with a staged build, the build image and the runtime image live in the same Dockerfile, which makes it harder to optimize the caching of third-party dependencies.微信公众号CICDCIDevOpsCacheOptimizationhttps://www.chenshaowen.com/en/blog/how-to-run-the-pipeline-on-remote-osx.htmlSun, 22 Nov 2020 00:00:00 +0000Sun, 22 Nov 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-run-the-pipeline-on-remote-osx.htmlThis article also applies to connecting physical machines with ARM or MIPS architectures and FreeBSD or Windows systems. If Jenkins can reach the build machine, you can skip the Frp part. 1. The Problem In scenarios where Kubernetes is the infrastructure, when Jenkins runs a build pipeline it creates a separate Pod for each pipeline for building.微信公众号JenkinsmacOSCICDCIDevOpshttps://www.chenshaowen.com/en/blog/how-to-use-docker-in-docker.htmlSat, 21 Nov 2020 00:00:00 +0000Sat, 21 Nov 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-use-docker-in-docker.html1. Typical Use Cases In CI, there is usually a CI Engine responsible for parsing the pipeline and controlling the whole build process, while the actual build is delegated to an Agent. Jenkins and GitLab both work this way. As shown below, there are many kinds of Agents that connect to the CI Engine.微信公众号DockerKubernetesContainersCICICDOperationsLearningDinDBuildJenkinshttps://www.chenshaowen.com/en/blog/ci-script-of-how-to-use-cdn-to-separate-frontend-and-backend-more.htmlSat, 15 Sep 2018 00:00:00 +0000Sat, 15 Sep 2018 00:00:00 +0000https://www.chenshaowen.com/en/blog/ci-script-of-how-to-use-cdn-to-separate-frontend-and-backend-more.htmlIn a team, any change to the development workflow must be paired with the corresponding automation tooling. Without a low enough cost of use, the change is meaningless, because nobody will actually use it. In the previous post we covered how to use a CDN for further frontend/backend separation; this微信公众号CICDNOptimizationDeploymentPaaSScriptingDevOpsR&Dhttps://www.chenshaowen.com/en/blog/some-common-scripts-in-ci.htmlTue, 17 Jul 2018 00:00:00 +0000Tue, 17 Jul 2018 00:00:00 +0000https://www.chenshaowen.com/en/blog/some-common-scripts-in-ci.htmlBecause I am responsible for the team’s shared CI matters, I often need to configure CI pipelines or help others solve problems, so I put together the CI scripts I use most often for easy reference. 1. Structure of .gitlab-ci.yml Below is the structure of a GitLab CI configuration file.微信公众号GitLabGitLab-CICIDevOpsContinuous IntegrationR&Dhttps://www.chenshaowen.com/en/blog/gitlab-ci-configuring-runner.htmlTue, 08 May 2018 00:00:00 +0000Tue, 08 May 2018 00:00:00 +0000https://www.chenshaowen.com/en/blog/gitlab-ci-configuring-runner.html1. Downloading and Configuring the Runner 1.1 Downloading the Runner The GitLab CI Runner is a program package written in Go; you can download it from the official site to your local machine. 1 2 yum install -y wget wget -O /usr/local/bin/gitlab-runner https://gitlab-runner-downloads.s3.amazonaws.com/latest/binaries/gitlab-runner-linux-amd64 Add execute permission 1 chmod +x /usr/local/bin/gitlab-runner 1.微信公众号GitLabGitLab-CICIRunnerDevOpsOperationshttps://www.chenshaowen.com/en/blog/jenkins-integrated-github-development.htmlTue, 18 Jul 2017 21:29:41 +0000Tue, 18 Jul 2017 21:29:41 +0000https://www.chenshaowen.com/en/blog/jenkins-integrated-github-development.html1. Basic Concepts Continuous Integration Continuous integration emphasizes that once developers commit new code, a build and (unit) test run immediately. From the test results we can determine whether the new code and the existing code integrate correctly. Continuous Delivery Building on continuous integration, continuous delivery deploys the integrated code微信公众号ToolsDevelopmentJenkinsGitHubCIDevOpsR&D