RuntimeErrorSidekiq/Ci::BuildTraceChunkFlushWorker: can't add a new key into hash during iteration
From Sentry: https://sentry.gitlab.net/gitlab/devgitlaborg/issues/1837678
Exception(most recent call first)
RuntimeError: can't add a new key into hash during iteration
from gitlab/sidekiq_daemon/monitor.rb:35:in `block in within_job'
from gitlab/sidekiq_daemon/monitor.rb:34:in `synchronize'
from gitlab/sidekiq_daemon/monitor.rb:34:in `within_job'
from gitlab/sidekiq_middleware/monitor.rb:7:in `call'
from sidekiq/middleware/chain.rb:130:in `block in invoke'
from marginalia/sidekiq_instrumentation.rb:10:in `call'
from sidekiq/middleware/chain.rb:130:in `block in invoke'
from raven/integrations/sidekiq.rb:9:in `call'
from sidekiq/middleware/chain.rb:130:in `block in invoke'
from sidekiq/middleware/chain.rb:133:in `invoke'
from sidekiq/processor.rb:164:in `block in process'
from sidekiq/processor.rb:137:in `block (6 levels) in dispatch'
from sidekiq/job_retry.rb:109:in `local'
from sidekiq/processor.rb:136:in `block (5 levels) in dispatch'
from sidekiq/rails.rb:43:in `block in call'
from active_support/execution_wrapper.rb:88:in `wrap'
from active_support/reloader.rb:72:in `block in wrap'
from active_support/execution_wrapper.rb:88:in `wrap'
from active_support/reloader.rb:71:in `wrap'
from sidekiq/rails.rb:42:in `call'
from sidekiq/processor.rb:132:in `block (4 levels) in dispatch'
from sidekiq/processor.rb:250:in `stats'
from sidekiq/processor.rb:127:in `block (3 levels) in dispatch'
from gitlab/sidekiq_logging/structured_logger.rb:18:in `call'
from sidekiq/processor.rb:126:in `block (2 levels) in dispatch'
from sidekiq/job_retry.rb:74:in `global'
from sidekiq/processor.rb:125:in `block in dispatch'
from sidekiq/logging.rb:48:in `with_context'
from sidekiq/logging.rb:42:in `with_job_hash_context'
from sidekiq/processor.rb:124:in `dispatch'
from sidekiq/processor.rb:163:in `process'
from sidekiq/processor.rb:83:in `process_one'
from sidekiq/processor.rb:71:in `run'
from sidekiq/util.rb:16:in `watchdog'
from sidekiq/util.rb:25:in `block in safe_thread'
@qzhaogitlab Not sure if this a regression, but this looks like a new error to me.