Auto-deploy staging_upload failed due to unable to load libffi
Pipeline https://dev.gitlab.org/gitlab/omnibus-gitlab/-/pipelines/285533/failures failed. For example, https://dev.gitlab.org/gitlab/omnibus-gitlab/-/jobs/16300372 failed:
LoadError: libffi.so.6: cannot open shared object file: No such file or directory - /builds/gitlab/omnibus-gitlab/gems/ruby/3.0.0/gems/ffi-1.15.5/lib/ffi_c.so
<internal:/usr/local/lib/ruby/site_ruby/3.0.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
<internal:/usr/local/lib/ruby/site_ruby/3.0.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
/builds/gitlab/omnibus-gitlab/gems/ruby/3.0.0/gems/ffi-1.15.5/lib/ffi.rb:5:in `rescue in <top (required)>'
/builds/gitlab/omnibus-gitlab/gems/ruby/3.0.0/gems/ffi-1.15.5/lib/ffi.rb:2:in `<top (required)>'
<internal:/usr/local/lib/ruby/site_ruby/3.0.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
<internal:/usr/local/lib/ruby/site_ruby/3.0.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
/builds/gitlab/omnibus-gitlab/gems/ruby/3.0.0/gems/llhttp-ffi-0.4.0/lib/llhttp.rb:3:in `<top (required)>'
<internal:/usr/local/lib/ruby/site_ruby/3.0.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
<internal:/usr/local/lib/ruby/site_ruby/3.0.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
/builds/gitlab/omnibus-gitlab/gems/ruby/3.0.0/gems/http-5.1.0/lib/http/response/parser.rb:3:in `<top (required)>'
<internal:/usr/local/lib/ruby/site_ruby/3.0.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
<internal:/usr/local/lib/ruby/site_ruby/3.0.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
/builds/gitlab/omnibus-gitlab/gems/ruby/3.0.0/gems/http-5.1.0/lib/http.rb:16:in `<top (required)>'
<internal:/usr/local/lib/ruby/site_ruby/3.0.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
<internal:/usr/local/lib/ruby/site_ruby/3.0.0/rubygems/core_ext/kernel_require.rb>:37:in `require'
/builds/gitlab/omnibus-gitlab/lib/gitlab/deployer_helper.rb:1:in `<top (required)>'
/builds/gitlab/omnibus-gitlab/lib/gitlab/tasks/gitlab_com.rake:1:in `require_relative'
/builds/gitlab/omnibus-gitlab/lib/gitlab/tasks/gitlab_com.rake:1:in `<top (required)>'
/builds/gitlab/omnibus-gitlab/gems/ruby/3.0.0/gems/rake-13.0.6/exe/rake:27:in `<top (required)>'
/usr/local/bin/bundle:25:in `load'
/usr/local/bin/bundle:25:in `<main>'
It seems this cache linked from the system ffi despite !6800 (merged):
$ ldd lib/ffi_c.so
linux-vdso.so.1 (0x00007ffd3cd16000)
libffi.so.6 => not found
libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007f0ebec99000)
libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007f0ebeaa7000)
libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007f0ebea84000)
/lib64/ld-linux-x86-64.so.2 (0x00007f0ebf01f000)