Incident on Shaowen Chen's Websitehttps://www.chenshaowen.com/en/tags/incident/Recent content in Incident on Shaowen Chen's WebsiteHugo -- gohugo.ioen©2016 - {year}, All Rights Reserved.Wed, 17 Aug 2022 00:00:00 +0000weeklyA Kubernetes Job Created Nearly 30,000 Pods and Almost Caused a Serious Incidenthttps://www.chenshaowen.com/en/blog/kubernetes-job-create-3w-pod-attack-cluster.htmlWed, 17 Aug 2022 00:00:00 +0000Wed, 17 Aug 2022 00:00:00 +0000https://www.chenshaowen.com/en/blog/kubernetes-job-create-3w-pod-attack-cluster.html1. Background At 10:00 in the morning, a colleague asked me to run a task on the cluster, so I created a Kubernetes Job through a tool. When the tool creates a Job, it first gets all the nodes on the cluster, then binds to each node one by one to create Jobs.WeChat Official AccountKubernetesJobPodIncidentTroubleshootingOperations