内容摘要：感谢这安静的环境，没有它们我是无法完成这篇文章的。单应用与环境多应用与环境CI持续集成首先准备一个代码库：https://github.com/DevOpsCICDCourse/microservic

 感谢这安静的微服务Cs完环境，没有它们我是践G计实无法完成这篇文章的。

单应用与环境

多应用与环境

CI持续集

成首先准备一个代码库：https://github.com/DevOpsCICDCourse/microservicescicd/blob/main/microservice-demo-service-master.zip

我们来梳理一下CI流水线的整设步骤：

由于此次实现的代码仓库类型为单一存储库，即一个存储库存放多个服务模块代码，微服务Cs完每个子目录为一个服务模块。践G计实 首先，整设我们的微服务Cs完持续集成流水线需要能够正确获取，当前的践G计实commit是哪个服务的代码。 确定好服务，整设然后下载该服务的微服务Cs完代码，进行编译打包、践G计实单元测试、整设代码扫描和构建镜像等步骤。微服务Cs完

如何获取commit的践G计实服务信息?这里我们使用GitLab WebHook功能和Jenkins 的高防服务器job 构建触发器对接来实现。

工作流程是整设：当我在Gitlab提交了代码，会通过GitLab webhook 触发Jenkins Scheduler 作业， 会将此次提交代码所产生的hook data数据信息以POST的方式传给Jenkins Job。此时Jenkins job可以编写使用Generic Hook插件获取此次POST请求传输过来的请求体Body信息。是一段JSON数据， 该job运行后编写Pipeline 解析JSON中的数据拿到所变更的服务模块信息。最后触发对应服务的CI作业进行构建。

CI-Scheduler 作业

此作业只需要开启webhook， 配置触发token(唯一性)。生成hookurl：http://jenkins.idevops.site/generic-webhook-trigger/invoke?token=microservicecicd-scheduler-CI

Jenkinsfile

pipeline {   agent any   stages{    stage("GetData"){     steps{      script {       echo "${ webHookData}"      data = readJSON  text: "${ webHookData}"      println(data)      env.branchName = data.ref - "refs/heads/"      env.commitId = data.checkout_sha      env.projectId = data.project_id      commits = data["commits"]      println("${ env.branchName}")      println("${ env.commitID}")      println("${ env.projectId}")      //env.moduleName = "service01"      changeServices = []                     for(commit in commits) {                          println(commit.id)                         //added                         for (add in commit.added) {                              s = add.split("/") as List                             if (s.size() > 1){                                  if (changeServices.indexOf(s[0]) == -1){                                      changeServices.add(s[0])                                 }                             }                         }                         //modified                         for (m in commit.modified) {                              s = m.split("/") as List                             // println s                             // println s.size()                             // println s[0]                             if (s.size() > 1){                                  // println changeServices.indexOf(s[0])                                 if (changeServices.indexOf(s[0]) == -1){                                      changeServices.add(s[0])                                 }                             }                         }                         //removed                         for (r in commit.removed) {                              s = r.split("/") as List                             println s                             if (s.size() > 1){                                  if (changeServices.indexOf(s[0]) == -1){                                      changeServices.add(s[0])                                 }                             }                         }                     }                     println(changeServices)                     //currentBuild.description = " Trigger by  ${ eventType} ${ changeServices}      }    }   }   stage(DefineService) {              steps {                  script{                      println(changeServices)                     //服务构建顺序控制                     services = [service02, service01]                     for (service in services){                          if (changeServices.indexOf(service) != -1){                              jobName = microservicecicd-+service+-service-CI                             build job: jobName, wait: false,  parameters: [string(name: branchName, value: "${ env.branchName}" ),                                                                            string(name: commitId,   value: "${ env.commitId}" ),                                                                             string(name: projectId,  value: "${ env.projectId}" )]                         }                     }                 }             }         }  } } 

GitLab 配置WebHook

开启webhook，配置hookurl：http://jenkins.idevops.site/generic-webhook-trigger/invoke?token=microservicecicd-scheduler-CI

CI流水线-CI作业

每个微服务创建一个CI作业，具有三个字符串参数：分支名称、commitID、项目ID。

Jenkinsfile

String branchName = "${ env.branchName}" String moduleName = "${ JOB_NAME}".split("/")[1].split("-")[1] String srcUrl = "http://gitlab.idevops.site/microservicecicd/microservicecicd-demo-service.git" String commitId = "${ env.commitId}" String projectId = "${ env.projectId}" pipeline {      agent {  node {  label "build" } }     stages {          stage(GetCode) {              steps {                  script {                      checkout([$class: GitSCM,                              branches: [[name: "${ branchName}"]],                              doGenerateSubmoduleConfigurations: false,                             extensions: [[$class: SparseCheckoutPaths,                                          sparseCheckoutPaths: [[path: "${ moduleName}"],[path: Dockerfile]]]],                              submoduleCfg: [],                              userRemoteConfigs: [[credentialsId: gitlab-admin-user,                                                 url: "${ srcUrl}"]]])                 }             }         }         stage("Build&Test"){              steps{                  script{                      echo "Build..........."                     sh """                     cd ${ moduleName}                      mvn clean package                     """                 }             }             post {                  always {                      junit "${ moduleName}/target/surefire-reports/*.xml"                 }             }         }         stage("SonarScan"){              steps{                  script{                      def sonarDate = sh returnStdout: true, script: date  +%Y%m%d%H%M%S                     sonarDate = sonarDate - "\n"                     withCredentials([string(credentialsId: sonar-admin-user, variable: sonartoken),                                     string(credentialsId: gitlab-user-token, variable: gitlabtoken)]) {                          // some block                         sh """                         cd ${ moduleName}                          sonar-scanner \                         -Dsonar.projectKey=${ JOB_NAME} \                         -Dsonar.projectName=${ JOB_NAME} \                         -Dsonar.projectVersion=${ sonarDate} \                         -Dsonar.ws.timeout=30 \                         -Dsonar.projectDescription="xxxxxxx" \                         -Dsonar.links.homepage=http://www.baidu.com \                         -Dsonar.sources=src \                         -Dsonar.sourceEncoding=UTF-8 \                         -Dsonar.java.binaries=target/classes \                         -Dsonar.java.test.binaries=target/test-classes \                         -Dsonar.java.surefire.report=target/surefire-reports \                         -Dsonar.host.url="http://sonar.idevops.site" \                         -Dsonar.login=${ sonartoken} \                         -Dsonar.gitlab.commit_sha=${ commitId} \                         -Dsonar.gitlab.ref_name=${ branchName} \                         -Dsonar.gitlab.project_id=${ projectId} \                         -Dsonar.dynamicAnalysis=reuseReports \                         -Dsonar.gitlab.failure_notification_mode=commit-status \                         -Dsonar.gitlab.url=http://gitlab.idevops.site \                         -Dsonar.gitlab.user_token=${ gitlabtoken} \                         -Dsonar.gitlab.api_version=v4                         """                     }                 }             }         }         stage("BuildImage"){              steps{                  script{                       withCredentials([usernamePassword(credentialsId: aliyun-registry-admin, passwordVariable: password, usernameVariable: username)]) {                           env.nowDate = sh  returnStdout: true, script: date  +%Y%m%d%H%M%S                          env.nowDate = env.nowDate - "\n"                          env.releaseVersion = "${ env.branchName}"                          env.imageTag = "${ releaseVersion}-${ nowDate}-${ commitId}"                          env.dockerImage = "registry.cn-beijing.aliyuncs.com/microservicecicd/microservicecicd-${ moduleName}-service:${ env.imageTag}"                          env.jarName = "${ moduleName}-${ branchName}-${ commitId}"                          sh """                              docker login -u ${ username} -p ${ password}  registry.cn-beijing.aliyuncs.com                              cd ${ moduleName} && docker build -t ${ dockerImage} -f ../Dockerfile --build-arg SERVICE_NAME=${ jarName} .                              sleep 1                              docker push ${ dockerImage}                              sleep 1                              docker rmi ${ dockerImage}                           """                     }                 }             }         }     } } 

GitOps-CI扩展部分

在原始CI作业的服务器托管步骤基础上，增加了一个更新环境的步骤。GitOps实践会将当前的基础环境部署文件存放到一个Git仓库中。我们的CI作业在完成镜像上传后，同时更新环境部署文件中的镜像标签信息。(所以我们需要先获取该环境文件并更新上传)

stage("PushFile"){            // when {            //   expression {  "${ env.branchName}".contains("RELEASE-") }           // }           steps{              script{                if ("${ env.branchName}".contains("RELEASE-")){                  println("branchName = branchName")                 env.branchName = "master"               } else {                  env.branchName = "feature"               }                 for (i = 0; i < 3; i++) {                      //下载版本库文件                      response = GetRepoFile(40,"${ moduleName}%2fvalues.yaml", "${ env.branchName}")                     //println(response)                     //替换文件中内容                     yamlData = readYaml text: """${ response}"""                     println(yamlData.image.version)                     println(yamlData.image.commit)                     yamlData.image.version = "${ releaseVersion}-${ env.nowDate}"                     yamlData.image.commit  = "${ commitId}"                     println(yamlData.toString())                     sh "rm -fr test.yaml"                     writeYaml charset: UTF-8, data: yamlData, file: test.yaml                     newYaml = sh returnStdout: true, script: cat test.yaml                     println(newYaml)                     //更新gitlab文件内容                     base64Content = newYaml.bytes.encodeBase64().toString()                     // 会有并行问题，同时更新报错                     try {                        UpdateRepoFile(40,"${ moduleName}%2fvalues.yaml",base64Content, "${ env.branchName}")                       break;                     } catch(e){                        sh "sleep 2"                       continue;                     }                 }             }           }         }  //封装HTTP请求 def HttpReq(reqType,reqUrl,reqBody){      def gitServer = "http://gitlab.idevops.site/api/v4"     withCredentials([string(credentialsId: gitlab-token, variable: gitlabToken)]) {        result = httpRequest customHeaders: [[maskValue: true, name: PRIVATE-TOKEN, value: "${ gitlabToken}"]],                  httpMode: reqType,                  contentType: "APPLICATION_JSON",                 consoleLogResponseBody: true,                 ignoreSslErrors: true,                  requestBody: reqBody,                 url: "${ gitServer}/${ reqUrl}"                 //quiet: true     }     return result } //获取文件内容 def GetRepoFile(projectId,filePath,branchName){      apiUrl = "projects/${ projectId}/repository/files/${ filePath}/raw?ref=${ branchName}"     response = HttpReq(GET,apiUrl,)     return response.content } //更新文件内容 def UpdateRepoFile(projectId,filePath,fileContent, branchName){      apiUrl = "projects/${ projectId}/repository/files/${ filePath}"     reqBody = """{ "branch": "${ branchName}","encoding":"base64", "content": "${ fileContent}", "commit_message": "update a new file"}"""     response = HttpReq(PUT,apiUrl,reqBody)     println(response) } 

images

GitOps-CD部分

CD-Scheduler作业

此作业其实也是接收GitLab的webhook请求， 与CI-scheduler作业类似。不同的是这个CD-scheduler作业是用来接收环境仓库的代码变更。开启webhook， 配置触发token。生成hookurl：http://jenkins.idevops.site/generic-webhook-trigger/invoke?token=microservicecicd-scheduler-CD

Jenkinsfile

pipeline {      agent any     stages {          stage(GetCommitService) {              steps {                  script{                      echo Hello World                     echo "${ WebHookData}"                     // Git Info                     webhookdata = readJSON text: """${ WebHookData}"""                     eventType = webhookdata["object_kind"]                     commits = webhookdata["commits"]                     branchName = webhookdata["ref"] - "refs/heads/"                     projectID = webhookdata["project_id"]                     commitID = webhookdata["checkout_sha"]                     changeServices = []                     for(commit in commits) {                          println(commit.id)                         //added                         for (add in commit.added) {                              s = add.split("/") as List                             if (s.size() > 1){                                  if (changeServices.indexOf(s[0]) == -1){                                      changeServices.add(s[0])                                 }                             }                         }                         //modified                         for (m in commit.modified) {                              s = m.split("/") as List                             // println s                             // println s.size()                             // println s[0]                             if (s.size() > 1){                                  // println changeServices.indexOf(s[0])                                 if (changeServices.indexOf(s[0]) == -1){                                      changeServices.add(s[0])                                 }                             }                         }                         //removed                         for (r in commit.removed) {                              s = r.split("/") as List                             println s                             if (s.size() > 1){                                  if (changeServices.indexOf(s[0]) == -1){                                      changeServices.add(s[0])                                 }                             }                         }                     }                     println(changeServices)                     currentBuild.description = " Trigger by  ${ eventType} ${ changeServices} "                 }             }         }         stage(DefineService) {              steps {                  script{                      println(changeServices)                     //服务构建顺序控制                     services = [service02, service01]                     for (service in services){                          if (changeServices.indexOf(service) != -1){                              jobName = microservicecicd-+service+-service-CD                             build job: jobName, wait: false,  parameters: [string(name: branchName, value: "${ branchName}" )]                         }                     }                 }             }         }     } } 

环境库配置webhook

开启webhook，配置hookurl：http://jenkins.idevops.site/generic-webhook-trigger/invoke?token=microservicecicd-scheduler-CD

CD流水线-CD作业

Jenkinsfile

String serviceName ="${ JOB_NAME}".split("-")[1] String nameSpace = "${ JOB_NAME}".split("-")[0].split("/")[-1] //pipeline pipeline{      agent {  node {  label "k8s"}}     stages{         stage("GetCode"){              steps{                  script{                      println("${ branchName}")                     println("${ env.branchName}".contains("RELEASE-"))                     println "获取代码"                     checkout([$class: GitSCM, branches: [[name: "${ env.branchName}"]],                                        doGenerateSubmoduleConfigurations: false,                                        extensions: [[$class: SparseCheckoutPaths,                                                      sparseCheckoutPaths: [[path: "${ serviceName}"]]]],                                        submoduleCfg: [],                                        userRemoteConfigs: [[credentialsId: gitlab-admin-user, url: "http://gitlab.idevops.site/microservicecicd/microservicecicd-env.git"]]])                 }             }         }         stage("HelmDeploy"){              steps{                  script{                    sh """                       kubectl create ns "${ nameSpace}-uat"  || echo false                       helm install "${ serviceName}" --namespace "${ nameSpace}-uat" ./"${ serviceName}" ||  helm upgrade "${ serviceName}" --namespace "${ nameSpace}-uat" ./"${ serviceName}"                       helm list --namespace "${ nameSpace}-uat"                       helm history "${ serviceName}" --namespace "${ nameSpace}-uat"                   """                 }             }         }     } }