Add more debugging to review-deploy failures
What does this MR do and why?
I think it might be useful to see to which nodes where pods deployed. It might help understand some crashloopbackoff issues.
Screenshots or screen recordings
Before
$ kubectl get svc,pods,jobs
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE
service/cert-manager ClusterIP 10.0.3.67 <none> 9402/TCP 49d
service/cert-manager-webhook ClusterIP 10.0.7.64 <none> 443/TCP 49d
service/dns-gitlab-review-app-helm3-external-dns ClusterIP 10.0.1.157 <none> 7979/TCP 5d19h
service/kubed ClusterIP 10.0.4.242 <none> 443/TCP 530d
service/tiller-deploy ClusterIP 10.0.5.101 <none> 44134/TCP 2y93d
NAME READY STATUS RESTARTS AGE
pod/cert-manager-7f5b465cc7-2dbmp 1/1 Running 0 97m
pod/cert-manager-cainjector-5dbf8fb54-wv5hj 1/1 Running 0 97m
pod/cert-manager-webhook-58798dc778-8bxdn 1/1 Running 0 97m
pod/dns-gitlab-review-app-helm3-external-dns-6bfc6599f6-b9d7q 1/1 Running 0 5d12h
pod/kubed-6866d89b95-h5vgm 1/1 Running 0 5d11h
NAME COMPLETIONS DURATION AGE
job.batch/review-automate-c-uphqew-migrations-26 1/1 3m9s 535d
job.batch/review-automate-c-uphqew-minio-create-buckets-26 1/1 15s 535d
job.batch/review-mw-rename-w3hjrv-migrations-3 1/1 3m23s 535d
job.batch/review-mw-rename-w3hjrv-minio-create-buckets-3 1/1 13s 535d
job.batch/review-ph-330749-x6fpoj-migrations-2 1/1 3m16s 543d
job.batch/review-ph-330749-x6fpoj-minio-create-buckets-2 1/1 13s 543dAfter
$ kubectl get svc,pods,jobs -o wide
NAME TYPE CLUSTER-IP EXTERNAL-IP PORT(S) AGE SELECTOR
service/cert-manager ClusterIP 10.0.3.67 <none> 9402/TCP 49d app.kubernetes.io/component=controller,app.kubernetes.io/instance=cert-manager,app.kubernetes.io/name=cert-manager
service/cert-manager-webhook ClusterIP 10.0.7.64 <none> 443/TCP 49d app.kubernetes.io/component=webhook,app.kubernetes.io/instance=cert-manager,app.kubernetes.io/name=webhook
service/dns-gitlab-review-app-helm3-external-dns ClusterIP 10.0.1.157 <none> 7979/TCP 5d19h app.kubernetes.io/instance=dns-gitlab-review-app-helm3,app.kubernetes.io/name=external-dns
service/kubed ClusterIP 10.0.4.242 <none> 443/TCP 530d app.kubernetes.io/instance=kubed,app.kubernetes.io/name=kubed
service/tiller-deploy ClusterIP 10.0.5.101 <none> 44134/TCP 2y93d app=helm,name=tiller
NAME READY STATUS RESTARTS AGE IP NODE NOMINATED NODE READINESS GATES
pod/cert-manager-7f5b465cc7-2dbmp 1/1 Running 0 97m 10.40.44.34 gke-review-apps-e2-16cpu-64gb-preempt-66885d25-cphj <none> <none>
pod/cert-manager-cainjector-5dbf8fb54-wv5hj 1/1 Running 0 97m 10.40.44.33 gke-review-apps-e2-16cpu-64gb-preempt-66885d25-cphj <none> <none>
pod/cert-manager-webhook-58798dc778-8bxdn 1/1 Running 0 97m 10.40.44.35 gke-review-apps-e2-16cpu-64gb-preempt-66885d25-cphj <none> <none>
pod/dns-gitlab-review-app-helm3-external-dns-6bfc6599f6-b9d7q 1/1 Running 0 5d12h 10.40.82.26 gke-review-apps-e2-16cpu-64gb-preempt-66885d25-yk1n <none> <none>
pod/kubed-6866d89b95-h5vgm 1/1 Running 0 5d11h 10.40.41.28 gke-review-apps-e2-16cpu-64gb-preempt-66885d25-7n2m <none> <none>
NAME COMPLETIONS DURATION AGE CONTAINERS IMAGES SELECTOR
job.batch/review-automate-c-uphqew-migrations-26 1/1 3m9s 535d migrations registry.gitlab.com/gitlab-org/build/cng-mirror/gitlab-rails-ee:automate-create-iterations-in-cadence controller-uid=6e10060a-0c77-4b2d-b699-7203d8fa4d83
job.batch/review-automate-c-uphqew-minio-create-buckets-26 1/1 15s 535d minio-mc minio/mc:RELEASE.2018-07-13T00-53-22Z controller-uid=3565a75c-93ea-4204-ad72-a43bed17c604
job.batch/review-mw-rename-w3hjrv-migrations-3 1/1 3m23s 535d migrations registry.gitlab.com/gitlab-org/build/cng-mirror/gitlab-rails-ee:mw-rename-external-approval-rules-to-status-checks controller-uid=e540f2b8-44f7-4398-9543-1cc68101b0f9
job.batch/review-mw-rename-w3hjrv-minio-create-buckets-3 1/1 13s 535d minio-mc minio/mc:RELEASE.2018-07-13T00-53-22Z controller-uid=bab74689-6c73-4520-bde5-a542e898f17a
job.batch/review-ph-330749-x6fpoj-migrations-2 1/1 3m16s 543d migrations registry.gitlab.com/gitlab-org/build/cng-mirror/gitlab-rails-ee:ph-330749-fixdiffslongfilename controller-uid=d1192678-e9e1-4ff4-bdbd-9db47fffaf3d
job.batch/review-ph-330749-x6fpoj-minio-create-buckets-2 1/1 13s 543d minio-mc minio/mc:RELEASE.2018-07-13T00-53-22Z controller-uid=febd37ec-4848-43ed-938e-5eaaa9d06540How to set up and validate locally
Numbered steps to set up and validate the change are strongly suggested.
MR acceptance checklist
This checklist encourages us to confirm any changes have been analyzed to reduce risks in quality, performance, reliability, security, and maintainability.
-
I have evaluated the MR acceptance checklist for this MR.