https://www.chenshaowen.com/en/tags/jenkins/Recent content in Jenkins on Shaowen Chen's WebsiteHugo -- gohugo.ioen©2016 - {year}, All Rights Reserved.Mon, 18 Jul 2022 00:00:00 +0000weeklyhttps://www.chenshaowen.com/en/blog/hijack-docker-io-req-to-private-repository.htmlMon, 18 Jul 2022 00:00:00 +0000Mon, 18 Jul 2022 00:00:00 +0000https://www.chenshaowen.com/en/blog/hijack-docker-io-req-to-private-repository.html1. Self-signing a *.docker.io Domain Certificate 1.1 Creating a CA Certificate Generate the CA certificate private key 1 openssl genrsa -out ca.key 4096 Generate the CA certificate 1 2 3 4 openssl req -x509 -new -nodes -sha512 -days 3650 \ -subj "/C=CN/ST=Beijing/L=Beijing/O=example/OU=Personal/CN=chenshaowen.com" \ -key ca.key \ -out ca.crt 1.2 Creating a *.微信公众号JenkinsKubernetesDockerImagesOperationsSecurityhttps://www.chenshaowen.com/en/blog/how-to-customize-your-jenkins.htmlSat, 05 Jun 2021 00:00:00 +0000Sat, 05 Jun 2021 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-customize-your-jenkins.html1. How to Deploy Jenkins To make the tests below easier, let me first introduce two ways to deploy Jenkins. Here I use the shaowenchen/jenkins:2.277.4 image. In a production environment, you should replace it with the official jenkins/jenkins image or your own custom image. 1.1 Running with docker-compose The docker-compose.yaml file微信公众号DevOpsCICDJenkinsDockerOperationshttps://www.chenshaowen.com/en/blog/using-podman-to-build-images-under-kubernetes-and-jenkins.htmlThu, 25 Feb 2021 00:00:00 +0000Thu, 25 Feb 2021 00:00:00 +0000https://www.chenshaowen.com/en/blog/using-podman-to-build-images-under-kubernetes-and-jenkins.htmlIn principle, Jenkins can use Podman to build images in any Kubernetes cluster; this article uses Containerd as the example. 1. Dropping Docker Brings New Challenges to CICD In CICD scenarios, we often need to build and push images within a pipeline. In an earlier document, Creating Jenkins Slaves Dynamically on Kubernetes, I described how mounting the /var/run/docker.微信公众号JenkinsDevOpsCICDDockerKubernetesPodmanhttps://www.chenshaowen.com/en/blog/how-to-run-the-pipeline-on-remote-osx.htmlSun, 22 Nov 2020 00:00:00 +0000Sun, 22 Nov 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-run-the-pipeline-on-remote-osx.htmlThis article also applies to connecting physical machines with ARM or MIPS architectures and FreeBSD or Windows systems. If Jenkins can reach the build machine, you can skip the Frp part. 1. The Problem In scenarios where Kubernetes is the infrastructure, when Jenkins runs a build pipeline it creates a separate Pod for each pipeline for building.微信公众号JenkinsmacOSCICDCIDevOpshttps://www.chenshaowen.com/en/blog/how-to-use-docker-in-docker.htmlSat, 21 Nov 2020 00:00:00 +0000Sat, 21 Nov 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-use-docker-in-docker.html1. Typical Use Cases In CI, there is usually a CI Engine responsible for parsing the pipeline and controlling the whole build process, while the actual build is delegated to an Agent. Jenkins and GitLab both work this way. As shown below, there are many kinds of Agents that connect to the CI Engine.微信公众号DockerKubernetesContainersCICICDOperationsLearningDinDBuildJenkinshttps://www.chenshaowen.com/en/blog/the-operation-guide-of-kubesphere-devops-3-0-pipeline.htmlWed, 14 Oct 2020 00:00:00 +0000Wed, 14 Oct 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/the-operation-guide-of-kubesphere-devops-3-0-pipeline.htmlThis post mainly covers how to operate and maintain a DevOps pipeline, and how to solve some common problems. The problems fall mainly into two categories: one is Kubernetes-related and fairly general in nature; the other is business-related and requires some understanding of the domain before you can solve problems微信公众号KubeSphereKubernetesDevOpsJenkinsOperationsCICDhttps://www.chenshaowen.com/en/blog/the-development-guide-of-kubesphere-devops-3-0-pipeline.htmlTue, 13 Oct 2020 00:00:00 +0000Tue, 13 Oct 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/the-development-guide-of-kubesphere-devops-3-0-pipeline.htmlKubeSphere DevOps consists of two parts: S2I and Pipeline. In the community, OpenShift provides an application packaging tool called S2I; for details, see Building Cloud-Native Applications with S2I . KubeSphere turned it into a service, using a CRD managed by a separate Operator, and its functionality is fairly self-contained. In 3.微信公众号KubeSphereKubernetesDevOpsJenkinsDevelopment EnvironmentR&DOperationshttps://www.chenshaowen.com/en/blog/jenkins-x-is-not-jenkins-but-stack.htmlSun, 16 Aug 2020 00:00:00 +0000Sun, 16 Aug 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/jenkins-x-is-not-jenkins-but-stack.html1. Introduction to Jenkins X Relying on its massive plugin ecosystem, Jenkins currently holds most of the enterprise CICD engine market share. But in the cloud native era, Jenkins has also exposed many problems: a single point of service, disk storage, memory usage, and so on. Around Kubernetes, Jenkins X offers a DevOps approach better suited to the cloud native era.微信公众号Tech StackJenkinsJenkins-XKubernetesDevOpsCICDOperationshttps://www.chenshaowen.com/en/blog/the-stress-test-about-kubernetes-dynamically-creates-jenkins-agent.htmlSun, 02 Aug 2020 00:00:00 +0000Sun, 02 Aug 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/the-stress-test-about-kubernetes-dynamically-creates-jenkins-agent.htmlIn the previous document, we took advantage of the elasticity Kubernetes provides to dynamically create Jenkins Slaves on Kubernetes. This document is mainly a stress test of Jenkins under large-scale builds. 1. Cluster Configuration 1.1 Kubernetes Version The version used here is v1.16.7 1 2 3 4 kubectl version Client Version: version.微信公众号JenkinsKubernetesDevOpsCICDTestingOperationshttps://www.chenshaowen.com/en/blog/the-question-of-lightweight-checkout-in-jenkins.htmlMon, 22 Jun 2020 00:00:00 +0000Mon, 22 Jun 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/the-question-of-lightweight-checkout-in-jenkins.html1. What Problem We Hit A Jenkins build log threw an error: 1 2 3 4 5 6 Started by user admin Lightweight checkout support not available, falling back to full checkout. Checking out git https://github.com/shaowenchen/pipeline-test.git into /var/jenkins_home/workspace/abc@script to read Jenkinsfile ... ... Unable to access '.git/index.lock': File exists. Cause analysis:微信公众号JenkinsGitDevOpsTroubleshootinghttps://www.chenshaowen.com/en/blog/artifacts-and-cache-in-jenkins.htmlSun, 21 Jun 2020 00:00:00 +0000Sun, 21 Jun 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/artifacts-and-cache-in-jenkins.htmlIn a CICD flow, there are two main kinds of things that need to be saved: build artifacts and caches. Build artifacts are the final execution result, and caches exist to speed up the next build. This post mainly describes how to archive build artifacts and caches in Jenkins, along with a hands-on example backed by object storage.微信公众号JenkinsS3DevOpsCachehttps://www.chenshaowen.com/en/blog/how-to-develop-the-plugin-of-jenkins.htmlSat, 20 Jun 2020 00:00:00 +0000Sat, 20 Jun 2020 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-develop-the-plugin-of-jenkins.htmlUsing Jenkins always means dealing with all kinds of plugins. To practice DevOps better, we should also be capable of developing plugins ourselves, so the whole process can converge inside Jenkins. 1. Jenkins Plugins 1.1 The Plugin Ecosystem Jenkins’ predecessor Hudson started in 2004, and 16 years on it is still a mainstream CI/CD engine.微信公众号JenkinsDevOpsCICDR&DPluginJavaLearninghttps://www.chenshaowen.com/en/blog/build-an-automated-test-system-using-kubernetes-and-jenkins.htmlThu, 12 Dec 2019 00:00:00 +0000Thu, 12 Dec 2019 00:00:00 +0000https://www.chenshaowen.com/en/blog/build-an-automated-test-system-using-kubernetes-and-jenkins.html1. Test Layering The purpose of testing is to verify expected behavior and uncover latent defects. Testing strengthens confidence that a qualified product can be delivered, and it is what makes agile iteration possible. You could say that testing determines the development pace of a product. The network model has the seven-layer OSI and the four-layer TCP, while development patterns include MTV, MVC, MVP, MVVM, and so on.微信公众号TestingAutomationKubernetesJenkinsDevOpsCICDOperationshttps://www.chenshaowen.com/en/blog/creating-jenkins-slave-dynamically-on-kubernetes.htmlFri, 06 Dec 2019 00:00:00 +0000Fri, 06 Dec 2019 00:00:00 +0000https://www.chenshaowen.com/en/blog/creating-jenkins-slave-dynamically-on-kubernetes.html1. Jenkins Working Modes Jenkins has a single-Master, multi-Slave architecture. The Master assigns tasks and manages services. Slaves execute the actual tasks. Even when multiple Masters are deployed, they remain independent of one another and cannot coordinate scheduling. A high-availability Jenkins solution requires an external task distribution framework, such as微信公众号JenkinsKubernetesCICDDevOpsOperationshttps://www.chenshaowen.com/en/blog/how-to-dial-up-testing-using-jenkins.htmlWed, 04 Dec 2019 00:00:00 +0000Wed, 04 Dec 2019 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-dial-up-testing-using-jenkins.html1. Why Dial Testing For some of the critical services in a system, we usually set up monitoring. When a failure occurs, it can be detected as quickly as possible and a notification sent to the people who care. Once a failure has occurred, the failure process can be traced微信公众号JenkinsDial TestingMonitoringDevOpsOperationshttps://www.chenshaowen.com/en/blog/how-to-use-jenkins-docker-gitlab-to-build-django-automated-deployment-process.htmlSun, 25 Nov 2018 00:00:00 +0000Sun, 25 Nov 2018 00:00:00 +0000https://www.chenshaowen.com/en/blog/how-to-use-jenkins-docker-gitlab-to-build-django-automated-deployment-process.htmlOne of the illusions that programmers at big companies easily fall into is mistaking platform capabilities for their own abilities. In a large team, we should not focus only on our own little patch of ground; we need to understand every part of the platform. On one hand, this helps us make better use of the platform’s features; on the other, it helps our own technical growth.微信公众号DjangoGitLabJenkinsDockerDevOpsCICDR&DOperationshttps://www.chenshaowen.com/en/blog/jenkins-integrated-robot-framework-testing.htmlSun, 05 Aug 2018 00:00:00 +0000Sun, 05 Aug 2018 00:00:00 +0000https://www.chenshaowen.com/en/blog/jenkins-integrated-robot-framework-testing.html1. Installing a Headless Browser 1.1 Installing PhantomJS on CentOS Download and extract Visit Phantomjs, find the download link for Download phantomjs-2.1.1-linux-x86_64.tar.bz2, and copy it. Run the following commands on CentOS: 1 2 3 4 5 wget https://bitbucket.org/ariya/phantomjs/downloads/phantomjs-2.1.1-linux-x86_64.tar.bz2 # 如果没有安装 bzip2 可能会报微信公众号RobotFrameworkAutomationContinuous IntegrationTestingDevOpsJenkinsR&Dhttps://www.chenshaowen.com/en/blog/jenkins-pipeline-usging-and-debug.htmlMon, 14 Aug 2017 13:13:55 +0000Mon, 14 Aug 2017 13:13:55 +0000https://www.chenshaowen.com/en/blog/jenkins-pipeline-usging-and-debug.html1. Basic Concepts master master is where Jenkins is installed and runs; it is responsible for parsing job scripts, handling tasks, and scheduling compute resources. agent agent is responsible for handling tasks dispatched from master; the actual operations are executed through an executor. executor An executor is the compute resource微信公众号JenkinsPipelineContinuous IntegrationDevOpsCICDDebuggingR&Dhttps://www.chenshaowen.com/en/blog/jenkins-integrated-github-development.htmlTue, 18 Jul 2017 21:29:41 +0000Tue, 18 Jul 2017 21:29:41 +0000https://www.chenshaowen.com/en/blog/jenkins-integrated-github-development.html1. Basic Concepts Continuous Integration Continuous integration emphasizes that once developers commit new code, a build and (unit) test run immediately. From the test results we can determine whether the new code and the existing code integrate correctly. Continuous Delivery Building on continuous integration, continuous delivery deploys the integrated code微信公众号ToolsDevelopmentJenkinsGitHubCIDevOpsR&D