`display_deployment_debug` needs to include pods RUNNING but not READY
In !18100 (merged), we changed display_deployment_debug
to show pods that are not RUNNING
. However, it turns out that a pod could be RUNNING
but the containers are not yet READY
, which leads to helm deployment timing out. We should list all the pods for the release I think, there aren't that many.
Using https://gitlab.com/gitlab-org/gitlab/-/jobs/314443989 as example:
Release "review-14686-brok-9be1ft" does not exist. Installing it now.
Error: release review-14686-brok-9be1ft failed: timed out waiting for the condition
Unready Pods for release review-14686-brok-9be1ft
NAME READY STATUS RESTARTS AGE
review-14686-brok-9be1ft-migrations.1-b2hjn 0/1 Completed 0 15m
review-14686-brok-9be1ft-minio-create-buckets.1-d88n7 0/1 Completed 0 15m
Unsuccessful Jobs for release review-14686-brok-9be1ft
No resources found.
Using another release for example, the unicorn pods are RUNNING
but has 0/2 READY
$ kubectl get pods -l release=review-17597-extr-603rmb
NAME READY STATUS RESTARTS AGE
review-17597-extr-603rmb-gitaly-0 1/1 Running 0 6m26s
review-17597-extr-603rmb-gitlab-shell-fdcd87b5d-bf9tj 1/1 Running 0 6m26s
review-17597-extr-603rmb-gitlab-shell-fdcd87b5d-f9g5j 1/1 Running 0 6m3s
review-17597-extr-603rmb-migrations.1-zlstl 0/1 Completed 0 6m26s
review-17597-extr-603rmb-minio-57c5d445d4-mp4x4 1/1 Running 0 6m26s
review-17597-extr-603rmb-minio-create-buckets.1-7446x 0/1 Completed 0 6m26s
review-17597-extr-603rmb-nginx-ingress-controller-bbdfd59d7s2hp 1/1 Running 0 6m26s
review-17597-extr-603rmb-nginx-ingress-controller-bbdfd59dqrbnt 0/1 CrashLoopBackOff 5 6m26s
review-17597-extr-603rmb-nginx-ingress-default-backend-6ccxst8v 1/1 Running 0 6m26s
review-17597-extr-603rmb-postgresql-59b58675fc-jfrzb 1/1 Running 0 6m25s
review-17597-extr-603rmb-redis-66879bc56c-qnwjf 2/2 Running 0 6m25s
review-17597-extr-603rmb-registry-786fc999c9-5qwts 1/1 Running 0 6m25s
review-17597-extr-603rmb-sidekiq-all-in-1-84c4557467-4kx7k 0/1 Init:2/3 0 6m26s
review-17597-extr-603rmb-task-runner-9c469d768-c56tg 1/1 Running 0 6m26s
review-17597-extr-603rmb-unicorn-6978c866ff-kjgh5 0/2 Running 0 6m26s
review-17597-extr-603rmb-unicorn-6978c866ff-mwzmk 0/2 Running 0 6m3s