Sidekiq backlog drastically grew after upgrading GitLab from 15.8.4 to 15.9.4

Summary

MR merges, Pipeline creations and Slack notifications got to take hours after upgrading GitLab from 15.8.4 to 15.9.4.
Analysing /var/log/gitlab/sidekiq/current found that below started happening immediately after the upgrade;

• ElasticIndexInitialBulkCronWorker and ElasticIndexBulkCronWorker were enqueued much more frequently than before the upgrade.
  The average enqueue interval shortened from 30 secs to 0.8 secs.
• The queue length and the scheduring_latency_s grew 1,000+ every hour and reached over 20,000.

See also below chart plotted the numbers obtained from /var/log/gitlab/sidekiq/current.
The upgrade was carried out at the middle of the timeline slightly before Apr-05 9:00 (UTC).
(By the way, it was 18:00 localtime. That was why the issue was left unnoticed for 15+ hours until next morning localtime.)

The issue ceased after below steps;

1. Disabled the feature flag parallel_bulk_cron_worker
2. gitlab-ctl restart
3. Deleted ElasticIndexInitialBulkCronWorker and ElasticIndexBulkCronWorker jobs from the default queue

This would suggest that #340963 (closed) and !110936 (merged) triggered the issue.

Additional info

• Sidekiq settings in the /etc/gitlab/gitlab.rb were not customized at all, i.e. all settings were defaults.
• Advanced Search and Elasticsearch have been disabled since the upgrade to 15.0.x where Elasticsearch 6.8 support was discontinued.

Results of GitLab environment info

Expand for output related to GitLab environment info

$ sudo gitlab-rake gitlab:env:info
System information
System:         Ubuntu 20.04
Proxy:          no
Current User:   git
Using RVM:      no
Ruby Version:   2.7.7p221
Gem Version:    3.1.6
Bundler Version:2.3.15
Rake Version:   13.0.6
Redis Version:  6.2.11
Sidekiq Version:6.5.7
Go Version:     unknown

GitLab information
Version:        15.9.4-ee
Revision:       901fa649189
Directory:      /opt/gitlab/embedded/service/gitlab-rails
DB Adapter:     PostgreSQL
DB Version:     12.12
URL:            https://gl.creationline.com
HTTP Clone URL: https://gl.creationline.com/some-group/some-project.git
SSH Clone URL:  git@gl.creationline.com:some-group/some-project.git
Elasticsearch:  no
Geo:            no
Using LDAP:     no
Using Omniauth: yes
Omniauth Providers: google_oauth2, gitlab, bitbucket

GitLab Shell
Version:        14.17.0
Repository storages:
- default:      unix:/var/opt/gitlab/gitaly/gitaly.socket
GitLab Shell path:              /opt/gitlab/embedded/service/gitlab-shell

Results of GitLab application Check

Expand for output related to the GitLab application check

$ sudo gitlab-rake gitlab:check SANITIZE=true
Checking GitLab subtasks ...
Checking GitLab Shell ...
GitLab Shell: ... GitLab Shell version >= 14.17.0 ? ... OK (14.17.0)
Running /opt/gitlab/embedded/service/gitlab-shell/bin/check
Internal API available: OK
Redis available via internal API: OK
gitlab-shell self-check successful
Checking GitLab Shell ... Finished
Checking Gitaly ...
Gitaly: ... default ... OK
Checking Gitaly ... Finished
Checking Sidekiq ...
Sidekiq: ... Running? ... yes
Number of Sidekiq processes (cluster/worker) ... 1/1
Checking Sidekiq ... Finished
Checking Incoming Email ...
Incoming Email: ... Reply by email is disabled in config/gitlab.yml
Checking Incoming Email ... Finished
Checking LDAP ...
LDAP: ... LDAP is disabled in config/gitlab.yml
Checking LDAP ... Finished
Checking GitLab App ...
Database config exists? ... yes
All migrations up? ... yes
Database contains orphaned GroupMembers? ... no
GitLab config exists? ... yes
GitLab config up to date? ... yes
Cable config exists? ... yes
Resque config exists? ... yes
Log directory writable? ... yes
Tmp directory writable? ... yes
Uploads directory exists? ... yes
Uploads directory has correct permissions? ... yes
Uploads directory tmp has correct permissions? ... yes
Systemd unit files or init script exist? ... skipped (omnibus-gitlab has neither init script nor systemd units)
Systemd unit files or init script up-to-date? ... skipped (omnibus-gitlab has neither init script nor systemd units)
Projects have namespace: ...
10/1 ... yes
10/2 ... yes
12/3 ... yes
16/4 ... yes
32/5 ... yes
32/6 ... yes
32/7 ... yes
18/8 ... yes
18/9 ... yes
18/10 ... yes
32/11 ... yes
18/12 ... yes
32/13 ... yes
32/14 ... yes
32/15 ... yes
32/16 ... yes
32/17 ... yes
14/18 ... yes
14/19 ... yes
14/20 ... yes
14/21 ... yes
14/22 ... yes
8/23 ... yes
14/24 ... yes
14/25 ... yes
7/26 ... yes
24/27 ... yes
24/28 ... yes
24/29 ... yes
24/30 ... yes
24/31 ... yes
24/32 ... yes
24/33 ... yes
7/34 ... yes
7/35 ... yes
14/37 ... yes
14/38 ... yes
14/39 ... yes
14/40 ... yes
15/41 ... yes
14/42 ... yes
14/43 ... yes
7/44 ... yes
191/45 ... yes
32/46 ... yes
32/47 ... yes
32/48 ... yes
32/49 ... yes
32/50 ... yes
32/51 ... yes
32/52 ... yes
32/53 ... yes
32/54 ... yes
32/55 ... yes
32/56 ... yes
32/57 ... yes
14/59 ... yes
26/60 ... yes
40/61 ... yes
34/62 ... yes
176/63 ... yes
37/64 ... yes
40/65 ... yes
40/66 ... yes
40/67 ... yes
40/68 ... yes
40/69 ... yes
40/70 ... yes
40/71 ... yes
40/72 ... yes
40/73 ... yes
40/74 ... yes
40/75 ... yes
176/76 ... yes
48/77 ... yes
43/78 ... yes
45/79 ... yes
51/80 ... yes
44/81 ... yes
41/82 ... yes
46/83 ... yes
47/84 ... yes
50/85 ... yes
42/86 ... yes
49/87 ... yes
52/88 ... yes
53/89 ... yes
53/90 ... yes
53/91 ... yes
58/92 ... yes
62/95 ... yes
61/96 ... yes
63/97 ... yes
60/98 ... yes
223/99 ... yes
66/100 ... yes
14/101 ... yes
32/102 ... yes
72/103 ... yes
65/104 ... yes
102/105 ... yes
102/106 ... yes
102/107 ... yes
102/108 ... yes
102/109 ... yes
102/110 ... yes
102/111 ... yes
102/112 ... yes
102/113 ... yes
102/114 ... yes
102/115 ... yes
102/116 ... yes
102/117 ... yes
102/118 ... yes
102/119 ... yes
102/120 ... yes
102/121 ... yes
102/122 ... yes
102/123 ... yes
102/124 ... yes
88/125 ... yes
79/126 ... yes
95/127 ... yes
78/128 ... yes
92/129 ... yes
90/130 ... yes
80/131 ... yes
82/132 ... yes
77/133 ... yes
93/134 ... yes
97/135 ... yes
89/136 ... yes
94/137 ... yes
81/138 ... yes
96/139 ... yes
15/140 ... yes
106/142 ... yes
106/143 ... yes
106/144 ... yes
106/145 ... yes
7/147 ... yes
128/149 ... yes
128/150 ... yes
128/151 ... yes
128/152 ... yes
128/153 ... yes
128/154 ... yes
128/155 ... yes
128/156 ... yes
128/157 ... yes
128/158 ... yes
128/159 ... yes
128/160 ... yes
128/161 ... yes
128/162 ... yes
128/163 ... yes
128/164 ... yes
128/165 ... yes
128/166 ... yes
128/167 ... yes
128/168 ... yes
118/169 ... yes
109/170 ... yes
108/171 ... yes
117/172 ... yes
111/173 ... yes
110/174 ... yes
112/175 ... yes
115/176 ... yes
114/177 ... yes
123/178 ... yes
116/179 ... yes
122/180 ... yes
124/181 ... yes
125/182 ... yes
113/183 ... yes
121/184 ... yes
126/185 ... yes
72/186 ... yes
149/187 ... yes
149/188 ... yes
149/189 ... yes
149/190 ... yes
149/191 ... yes
149/192 ... yes
149/193 ... yes
149/194 ... yes
149/195 ... yes
149/196 ... yes
149/197 ... yes
149/198 ... yes
149/199 ... yes
149/200 ... yes
149/201 ... yes
149/202 ... yes
149/203 ... yes
149/204 ... yes
149/205 ... yes
149/206 ... yes
130/207 ... yes
135/208 ... yes
133/209 ... yes
131/210 ... yes
136/211 ... yes
134/212 ... yes
132/213 ... yes
129/214 ... yes
150/215 ... yes
67/216 ... yes
7/217 ... yes
399/218 ... yes
18/223 ... yes
32/224 ... yes
32/225 ... yes
72/226 ... yes
72/229 ... yes
72/231 ... yes
72/232 ... yes
72/233 ... yes
393/237 ... yes
153/238 ... yes
32/239 ... yes
72/241 ... yes
72/242 ... yes
10/243 ... yes
7/244 ... yes
66/245 ... yes
72/246 ... yes
24/247 ... yes
14/248 ... yes
162/249 ... yes
7/250 ... yes
14/251 ... yes
361/252 ... yes
162/253 ... yes
393/254 ... yes
61/255 ... yes
8/256 ... yes
19/257 ... yes
62/258 ... yes
65/259 ... yes
156/260 ... yes
65/261 ... yes
393/262 ... yes
18/263 ... yes
393/264 ... yes
393/265 ... yes
62/267 ... yes
20/268 ... yes
18/269 ... yes
10/270 ... yes
7/272 ... yes
67/273 ... yes
20/276 ... yes
14/279 ... yes
60/280 ... yes
7/282 ... yes
7/283 ... yes
171/284 ... yes
171/285 ... yes
171/286 ... yes
176/287 ... yes
7/288 ... yes
15/289 ... yes
20/290 ... yes
29/291 ... yes
173/292 ... yes
21/293 ... yes
175/294 ... yes
390/295 ... yes
37/296 ... yes
28/297 ... yes
7/298 ... yes
27/299 ... yes
174/300 ... yes
7/301 ... yes
61/302 ... yes
171/303 ... yes
173/304 ... yes
173/305 ... yes
7/306 ... yes
177/307 ... yes
60/308 ... yes
66/309 ... yes
72/310 ... yes
7/311 ... yes
7/312 ... yes
171/313 ... yes
7/314 ... yes
392/315 ... yes
20/317 ... yes
181/318 ... yes
66/319 ... yes
14/322 ... yes
7/323 ... yes
181/324 ... yes
181/325 ... yes
181/326 ... yes
181/327 ... yes
173/329 ... yes
173/330 ... yes
173/331 ... yes
181/332 ... yes
349/334 ... yes
181/335 ... yes
66/336 ... yes
181/337 ... yes
181/338 ... yes
62/339 ... yes
7/342 ... yes
7/343 ... yes
7/344 ... yes
20/346 ... yes
62/347 ... yes
7/348 ... yes
62/351 ... yes
32/352 ... yes
32/353 ... yes
349/355 ... yes
7/357 ... yes
7/358 ... yes
349/359 ... yes
62/360 ... yes
181/361 ... yes
39/362 ... yes
171/364 ... yes
7/371 ... yes
388/372 ... yes
72/377 ... yes
14/378 ... yes
191/381 ... yes
7/382 ... yes
181/383 ... yes
349/386 ... yes
7/388 ... yes
192/389 ... yes
7/390 ... yes
192/391 ... yes
193/392 ... yes
193/393 ... yes
193/394 ... yes
193/395 ... yes
193/396 ... yes
193/397 ... yes
176/398 ... yes
196/400 ... yes
196/402 ... yes
196/403 ... yes
196/404 ... yes
196/405 ... yes
194/406 ... yes
196/407 ... yes
213/408 ... yes
209/409 ... yes
208/410 ... yes
217/411 ... yes
212/412 ... yes
220/413 ... yes
219/414 ... yes
218/415 ... yes
210/416 ... yes
216/418 ... yes
221/419 ... yes
222/420 ... yes
219/424 ... yes
216/425 ... yes
218/426 ... yes
217/427 ... yes
220/428 ... yes
212/430 ... yes
222/431 ... yes
221/432 ... yes
208/433 ... yes
213/434 ... yes
208/435 ... yes
216/436 ... yes
217/437 ... yes
212/438 ... yes
221/439 ... yes
219/440 ... yes
220/441 ... yes
213/442 ... yes
218/443 ... yes
103/444 ... yes
222/445 ... yes
191/447 ... yes
191/448 ... yes
196/449 ... yes
224/450 ... yes
7/451 ... yes
228/452 ... yes
349/453 ... yes
176/623 ... yes
60/624 ... yes
72/626 ... yes
223/627 ... yes
315/628 ... yes
56/629 ... yes
22/630 ... yes
320/633 ... yes
392/635 ... yes
349/636 ... yes
22/641 ... yes
322/643 ... yes
10/644 ... yes
60/649 ... yes
66/650 ... yes
349/651 ... yes
326/652 ... yes
66/653 ... yes
24/654 ... yes
349/655 ... yes
349/656 ... yes
349/657 ... yes
349/658 ... yes
14/659 ... yes
349/660 ... yes
349/662 ... yes
228/663 ... yes
349/665 ... yes
7/670 ... yes
181/671 ... yes
60/672 ... yes
72/674 ... yes
330/678 ... yes
349/680 ... yes
330/681 ... yes
352/682 ... yes
170/684 ... yes
7/685 ... yes
170/687 ... yes
7/688 ... yes
388/689 ... yes
339/690 ... yes
326/691 ... yes
170/692 ... yes
20/694 ... yes
72/696 ... yes
72/697 ... yes
352/700 ... yes
223/701 ... yes
170/705 ... yes
349/706 ... yes
191/707 ... yes
713/708 ... yes
181/709 ... yes
9/710 ... yes
181/711 ... yes
72/712 ... yes
353/713 ... yes
60/714 ... yes
352/715 ... yes
352/716 ... yes
352/717 ... yes
352/718 ... yes
352/719 ... yes
349/721 ... yes
349/723 ... yes
60/724 ... yes
326/725 ... yes
363/726 ... yes
364/727 ... yes
353/728 ... yes
353/729 ... yes
62/730 ... yes
181/731 ... yes
7/734 ... yes
176/735 ... yes
182/736 ... yes
315/737 ... yes
315/738 ... yes
315/740 ... yes
315/741 ... yes
349/742 ... yes
315/747 ... yes
713/748 ... yes
713/749 ... yes
181/750 ... yes
315/751 ... yes
62/752 ... yes
339/754 ... yes
7/755 ... yes
315/756 ... yes
7/757 ... yes
7/759 ... yes
7/760 ... yes
315/761 ... yes
7/762 ... yes
8/764 ... yes
334/765 ... yes
390/766 ... yes
339/768 ... yes
191/769 ... yes
7/773 ... yes
62/775 ... yes
32/779 ... yes
32/780 ... yes
389/781 ... yes
389/782 ... yes
32/783 ... yes
32/784 ... yes
392/785 ... yes
392/786 ... yes
168/787 ... yes
7/788 ... yes
65/790 ... yes
349/791 ... yes
56/792 ... yes
392/793 ... yes
390/794 ... yes
405/795 ... yes
395/797 ... yes
396/798 ... yes
397/799 ... yes
396/800 ... yes
18/801 ... yes
32/802 ... yes
399/803 ... yes
399/804 ... yes
399/805 ... yes
399/806 ... yes
399/807 ... yes
399/808 ... yes
399/809 ... yes
399/810 ... yes
399/811 ... yes
399/812 ... yes
399/813 ... yes
399/814 ... yes
32/815 ... yes
72/816 ... yes
403/817 ... yes
315/818 ... yes
185/820 ... yes
349/821 ... yes
61/822 ... yes
406/823 ... yes
406/824 ... yes
406/825 ... yes
392/826 ... yes
65/827 ... yes
65/828 ... yes
315/830 ... yes
181/832 ... yes
56/833 ... yes
434/835 ... yes
397/837 ... yes
62/840 ... yes
7/841 ... yes
434/842 ... yes
72/843 ... yes
339/844 ... yes
176/845 ... yes
7/847 ... yes
62/848 ... yes
7/849 ... yes
414/850 ... yes
462/852 ... yes
464/853 ... yes
414/855 ... yes
507/858 ... yes
470/859 ... yes
434/860 ... yes
507/861 ... yes
388/862 ... yes
466/864 ... yes
466/865 ... yes
411/866 ... yes
26/867 ... yes
59/868 ... yes
330/870 ... yes
414/872 ... yes
59/875 ... yes
507/876 ... yes
18/877 ... yes
72/878 ... yes
470/881 ... yes
168/882 ... yes
472/883 ... yes
473/884 ... yes
472/885 ... yes
474/886 ... yes
168/887 ... yes
473/888 ... yes
474/889 ... yes
476/890 ... yes
168/891 ... yes
471/892 ... yes
476/893 ... yes
390/894 ... yes
476/895 ... yes
315/896 ... yes
315/897 ... yes
343/898 ... yes
20/899 ... yes
62/900 ... yes
315/901 ... yes
67/903 ... yes
20/904 ... yes
315/905 ... yes
315/906 ... yes
315/907 ... yes
315/908 ... yes
479/909 ... yes
479/911 ... yes
476/912 ... yes
349/913 ... yes
339/915 ... yes
223/916 ... yes
352/917 ... yes
62/919 ... yes
486/921 ... yes
442/922 ... yes
442/923 ... yes
442/924 ... yes
442/925 ... yes
442/926 ... yes
485/927 ... yes
442/928 ... yes
442/929 ... yes
442/930 ... yes
442/931 ... yes
442/932 ... yes
442/933 ... yes
442/934 ... yes
442/935 ... yes
442/936 ... yes
442/937 ... yes
442/938 ... yes
442/939 ... yes
442/940 ... yes
442/941 ... yes
442/942 ... yes
442/943 ... yes
442/944 ... yes
442/945 ... yes
442/946 ... yes
487/948 ... yes
442/949 ... yes
442/950 ... yes
442/951 ... yes
442/952 ... yes
442/953 ... yes
442/954 ... yes
442/955 ... yes
442/956 ... yes
442/957 ... yes
442/958 ... yes
442/959 ... yes
442/960 ... yes
442/961 ... yes
442/962 ... yes
442/963 ... yes
442/964 ... yes
442/965 ... yes
442/966 ... yes
442/967 ... yes
442/968 ... yes
442/969 ... yes
442/970 ... yes
442/971 ... yes
442/972 ... yes
442/973 ... yes
442/974 ... yes
442/975 ... yes
442/976 ... yes
442/977 ... yes
442/978 ... yes
442/979 ... yes
442/980 ... yes
442/981 ... yes
442/982 ... yes
442/983 ... yes
442/984 ... yes
442/985 ... yes
442/986 ... yes
442/987 ... yes
442/988 ... yes
442/989 ... yes
442/990 ... yes
442/991 ... yes
476/992 ... yes
20/993 ... yes
496/994 ... yes
20/995 ... yes
502/997 ... yes
343/998 ... yes
507/999 ... yes
507/1000 ... yes
507/1001 ... yes
507/1002 ... yes
511/1003 ... yes
510/1004 ... yes
28/1005 ... yes
11/1006 ... yes
513/1011 ... yes
462/1012 ... yes
7/1013 ... yes
56/1014 ... yes
514/1015 ... yes
182/1017 ... yes
515/1018 ... yes
191/1019 ... yes
62/1020 ... yes
181/1021 ... yes
72/1022 ... yes
486/1023 ... yes
7/1024 ... yes
352/1025 ... yes
489/1026 ... yes
524/1028 ... yes
524/1030 ... yes
315/1032 ... yes
528/1033 ... yes
474/1035 ... yes
539/1036 ... yes
531/1037 ... yes
532/1038 ... yes
533/1039 ... yes
528/1040 ... yes
528/1042 ... yes
528/1043 ... yes
528/1044 ... yes
414/1045 ... yes
343/1047 ... yes
345/1048 ... yes
173/1049 ... yes
59/1050 ... yes
223/1051 ... yes
463/1052 ... yes
537/1053 ... yes
20/1055 ... yes
20/1057 ... yes
543/1058 ... yes
223/1059 ... yes
354/1060 ... yes
2024/1061 ... yes
546/1062 ... yes
529/1063 ... yes
20/1064 ... yes
528/1066 ... yes
20/1067 ... yes
463/1068 ... yes
181/1069 ... yes
181/1070 ... yes
181/1071 ... yes
65/1072 ... yes
434/1073 ... yes
434/1074 ... yes
474/1075 ... yes
349/1076 ... yes
339/1077 ... yes
425/1078 ... yes
349/1079 ... yes
554/1081 ... yes
20/1082 ... yes
359/1083 ... yes
349/1084 ... yes
550/1085 ... yes
20/1086 ... yes
20/1087 ... yes
414/1088 ... yes
555/1089 ... yes
2021/1090 ... yes
558/1091 ... yes
558/1093 ... yes
381/1094 ... yes
558/1095 ... yes
56/1097 ... yes
434/1098 ... yes
558/1099 ... yes
339/1100 ... yes
339/1101 ... yes
563/1102 ... yes
558/1103 ... yes
571/1104 ... yes
558/1105 ... yes
352/1106 ... yes
573/1107 ... yes
558/1108 ... yes
574/1109 ... yes
7/1110 ... yes
463/1111 ... yes
558/1112 ... yes
574/1114 ... yes
173/1115 ... yes
558/1116 ... yes
339/1118 ... yes
581/1119 ... yes
425/1121 ... yes
571/1122 ... yes
2021/1123 ... yes
536/1124 ... yes
597/1125 ... yes
600/1126 ... yes
405/1128 ... yes
600/1129 ... yes
600/1130 ... yes
7/1131 ... yes
414/1133 ... yes
571/1134 ... yes
571/1135 ... yes
343/1136 ... yes
181/1137 ... yes
359/1138 ... yes
65/1139 ... yes
680/1141 ... yes
571/1142 ... yes
614/1143 ... yes
160/1144 ... yes
160/1145 ... yes
160/1146 ... yes
610/1147 ... yes
1823/1148 ... yes
160/1149 ... yes
600/1150 ... yes
352/1151 ... yes
349/1152 ... yes
160/1153 ... yes
8/1154 ... yes
389/1155 ... yes
352/1157 ... yes
8/1158 ... yes
610/1159 ... yes
616/1161 ... yes
616/1163 ... yes
339/1165 ... yes
380/1166 ... yes
563/1167 ... yes
62/1168 ... yes
705/1169 ... yes
72/1170 ... yes
558/1172 ... yes
600/1174 ... yes
396/1175 ... yes
486/1176 ... yes
352/1177 ... yes
339/1178 ... yes
176/1179 ... yes
610/1180 ... yes
600/1181 ... yes
600/1182 ... yes
600/1183 ... yes
339/1184 ... yes
642/1185 ... yes
645/1188 ... yes
616/1193 ... yes
600/1195 ... yes
653/1196 ... yes
354/1197 ... yes
24/1198 ... yes
160/1199 ... yes
663/1200 ... yes
563/1201 ... yes
339/1202 ... yes
537/1203 ... yes
537/1204 ... yes
590/1205 ... yes
339/1206 ... yes
436/1207 ... yes
600/1208 ... yes
600/1209 ... yes
343/1210 ... yes
414/1211 ... yes
414/1212 ... yes
74/1213 ... yes
600/1214 ... yes
414/1215 ... yes
678/1216 ... yes
713/1217 ... yes
678/1218 ... yes
678/1220 ... yes
678/1221 ... yes
678/1222 ... yes
678/1223 ... yes
616/1225 ... yes
65/1227 ... yes
339/1228 ... yes
495/1229 ... yes
681/1230 ... yes
176/1232 ... yes
392/1233 ... yes
637/1234 ... yes
637/1235 ... yes
359/1238 ... yes
600/1239 ... yes
62/1240 ... yes
684/1241 ... yes
27/1242 ... yes
27/1243 ... yes
600/1244 ... yes
684/1245 ... yes
563/1246 ... yes
7/1247 ... yes
692/1248 ... yes
2021/1249 ... yes
693/1252 ... yes
600/1253 ... yes
690/1254 ... yes
693/1260 ... yes
191/1261 ... yes
695/1262 ... yes
695/1263 ... yes
696/1264 ... yes
343/1265 ... yes
690/1266 ... yes
600/1267 ... yes
600/1268 ... yes
695/1269 ... yes
339/1270 ... yes
339/1271 ... yes
600/1272 ... yes
352/1273 ... yes
610/1274 ... yes
600/1276 ... yes
600/1278 ... yes
690/1279 ... yes
600/1280 ... yes
28/1281 ... yes
174/1282 ... yes
62/1283 ... yes
713/1284 ... yes
748/1285 ... yes
672/1286 ... yes
713/1287 ... yes
663/1288 ... yes
663/1289 ... yes
1902/1290 ... yes
663/1291 ... yes
352/1292 ... yes
352/1293 ... yes
600/1294 ... yes
29/1295 ... yes
672/1297 ... yes
352/1298 ... yes
352/1299 ... yes
563/1300 ... yes
62/1302 ... yes
672/1303 ... yes
600/1304 ... yes
600/1305 ... yes
359/1306 ... yes
160/1307 ... yes
160/1308 ... yes
764/1309 ... yes
764/1311 ... yes
764/1312 ... yes
764/1313 ... yes
29/1314 ... yes
29/1315 ... yes
29/1316 ... yes
29/1317 ... yes
29/1318 ... yes
29/1319 ... yes
160/1320 ... yes
352/1321 ... yes
2021/1322 ... yes
160/1323 ... yes
1758/1324 ... yes
160/1325 ... yes
160/1327 ... yes
563/1329 ... yes
748/1330 ... yes
62/1331 ... yes
160/1332 ... yes
62/1336 ... yes
16/1337 ... yes
710/1340 ... yes
610/1341 ... yes
563/1342 ... yes
600/1343 ... yes
414/1344 ... yes
1812/1345 ... yes
1789/1346 ... yes
563/1347 ... yes
1795/1348 ... yes
2021/1349 ... yes
1803/1350 ... yes
59/1351 ... yes
705/1352 ... yes
330/1354 ... yes
1813/1355 ... yes
72/1356 ... yes
1817/1357 ... yes
1823/1358 ... yes
339/1359 ... yes
610/1361 ... yes
1835/1362 ... yes
1834/1363 ... yes
352/1364 ... yes
396/1365 ... yes
537/1366 ... yes
637/1367 ... yes
181/1368 ... yes
1845/1369 ... yes
181/1370 ... yes
563/1371 ... yes
181/1372 ... yes
600/1373 ... yes
1852/1376 ... yes
1852/1378 ... yes
1852/1379 ... yes
705/1380 ... yes
705/1381 ... yes
392/1382 ... yes
600/1384 ... yes
2021/1385 ... yes
637/1386 ... yes
637/1387 ... yes
1852/1388 ... yes
616/1389 ... yes
746/1390 ... yes
1918/1392 ... yes
705/1393 ... yes
1899/1394 ... yes
1899/1395 ... yes
1902/1396 ... yes
1890/1400 ... yes
690/1402 ... yes
7/1403 ... yes
590/1404 ... yes
62/1405 ... yes
373/1406 ... yes
1918/1407 ... yes
1920/1408 ... yes
705/1409 ... yes
425/1411 ... yes
1926/1412 ... yes
425/1413 ... yes
1926/1414 ... yes
690/1415 ... yes
1933/1417 ... yes
690/1418 ... yes
62/1419 ... yes
705/1420 ... yes
425/1421 ... yes
590/1422 ... yes
1943/1423 ... yes
1943/1424 ... yes
1943/1425 ... yes
463/1426 ... yes
637/1427 ... yes
1950/1428 ... yes
705/1429 ... yes
1950/1430 ... yes
1950/1431 ... yes
1968/1433 ... yes
1950/1434 ... yes
352/1435 ... yes
600/1436 ... yes
1962/1437 ... yes
1962/1438 ... yes
1962/1439 ... yes
1962/1440 ... yes
1962/1441 ... yes
600/1442 ... yes
1968/1443 ... yes
705/1444 ... yes
1950/1445 ... yes
1975/1446 ... yes
1803/1447 ... yes
62/1448 ... yes
563/1449 ... yes
1950/1450 ... yes
1950/1451 ... yes
352/1452 ... yes
343/1453 ... yes
1992/1454 ... yes
637/1456 ... yes
72/1457 ... yes
1999/1458 ... yes
705/1459 ... yes
1920/1460 ... yes
62/1461 ... yes
1920/1463 ... yes
2012/1466 ... yes
2012/1467 ... yes
181/1472 ... yes
563/1473 ... yes
339/1474 ... yes
63/1475 ... yes
63/1476 ... yes
563/1477 ... yes
563/1478 ... yes
2056/1479 ... yes
2048/1480 ... yes
2060/1481 ... yes
Redis version >= 6.0.0? ... yes
Ruby version >= 2.7.2 ? ... yes (2.7.7)
Git user has default SSH configuration? ... yes
Active users: ... 125
Is authorized keys file accessible? ... yes
GitLab configured to store new projects in hashed storage? ... yes
All projects are in hashed storage? ... yes
Elasticsearch version 7.x-8.x or OpenSearch version 1.x ... skipped (Advanced Search is disabled)
All migrations must be finished before doing a major upgrade ... skipped (Advanced Search is disabled)
Checking GitLab App ... Finished
Checking GitLab subtasks ... Finished

Possible fixes

Temporary Workaround

Dmitry has noted that we could temporarily pause Elastic indexing to ease that load:

ApplicationSetting.current.update!(elasticsearch_pause_indexing: true)