nixbot

1these 13 derivations will be built:2  /nix/store/9napib4ypfhs4cvvmndbvaih6mr1vwg5-python3.13-nixbot.drv3  /nix/store/l0crcd7l1s9chx3w2ssaqrgpn03lbp2c-unit-nixbot.service.drv4  /nix/store/aanb56a48v1xkj3ga5w2q1gf2nppmkql-system-units.drv5  /nix/store/xw1v9v9g1h9zs0529xr64iwp2bc42wv7-etc.drv6  /nix/store/azdkh5g52nr5ndvf2i6d06l8x18697fs-activate.drv7  /nix/store/i1sddng8nl4znkhwxhs3g3kaiclh3xn8-nixos-system-gitlab-test.drv8  /nix/store/ymp56b5pb7yim0jfcqm9ywrr3pydzjih-closure-info.drv9  /nix/store/q2jw38d53gd79pf43kdzh9a8qpw9jw3l-closure-info.drv10  /nix/store/fyv9jpcn05qwzqk76r6gzw82415fsirh-run-nixos-vm.drv11  /nix/store/ciyr41amn7854g2wjbsq2b1vc8g0scry-nixos-vm.drv12  /nix/store/8jwr29px7k36d8faqfq7dj5ay0bv1ncr-driverConfiguration.json.drv13  /nix/store/33ixl7d8nrkgl1qycw9vw2r54n2i3igb-nixos-test-driver-nixbot-gitlab.drv14  /nix/store/h8vyj0ydy4la4xqdz2i7p49pydf7zs7v-vm-test-run-nixbot-gitlab.drv15building '/nix/store/9napib4ypfhs4cvvmndbvaih6mr1vwg5-python3.13-nixbot.drv' on 'ssh-ng://nix@eliza'16building '/nix/store/9napib4ypfhs4cvvmndbvaih6mr1vwg5-python3.13-nixbot.drv'17python3.13-nixbot> Sourcing python-remove-tests-dir-hook18python3.13-nixbot> Sourcing python-catch-conflicts-hook.sh19python3.13-nixbot> Sourcing python-remove-bin-bytecode-hook.sh20python3.13-nixbot> Sourcing pypa-build-hook21python3.13-nixbot> Using pypaBuildPhase22python3.13-nixbot> Sourcing python-runtime-deps-check-hook23python3.13-nixbot> Using pythonRuntimeDepsCheckHook24python3.13-nixbot> Sourcing pypa-install-hook25python3.13-nixbot> Using pypaInstallPhase26python3.13-nixbot> Sourcing python-imports-check-hook.sh27python3.13-nixbot> Using pythonImportsCheckPhase28python3.13-nixbot> Sourcing python-namespaces-hook29python3.13-nixbot> Sourcing python-catch-conflicts-hook.sh30python3.13-nixbot> Running phase: unpackPhase31python3.13-nixbot> unpacking source archive /nix/store/lx5k613j9may44lv7cpbvqj1cz13xgg8-nixbot32python3.13-nixbot> source root is nixbot33python3.13-nixbot> setting SOURCE_DATE_EPOCH to timestamp 315619200 of file "nixbot/pyproject.toml"34python3.13-nixbot> Running phase: patchPhase35python3.13-nixbot> Running phase: updateAutotoolsGnuConfigScriptsPhase36python3.13-nixbot> Running phase: configurePhase37python3.13-nixbot> no configure script, doing nothing38python3.13-nixbot> Running phase: buildPhase39python3.13-nixbot> Executing pypaBuildPhase40python3.13-nixbot> Creating a wheel...41python3.13-nixbot> pypa build flags: --no-isolation --outdir dist/ --wheel42python3.13-nixbot> * Getting build dependencies for wheel...43python3.13-nixbot> * Building wheel...44python3.13-nixbot> Successfully built nixbot-0.0.1-py3-none-any.whl45python3.13-nixbot> Finished creating a wheel...46python3.13-nixbot> Finished executing pypaBuildPhase47python3.13-nixbot> Running phase: pythonRuntimeDepsCheckHook48python3.13-nixbot> Executing pythonRuntimeDepsCheck49python3.13-nixbot> Checking runtime dependencies for nixbot-0.0.1-py3-none-any.whl50python3.13-nixbot> Finished executing pythonRuntimeDepsCheck51python3.13-nixbot> Running phase: installPhase52python3.13-nixbot> Executing pypaInstallPhase53python3.13-nixbot> Successfully installed nixbot-0.0.1-py3-none-any.whl54python3.13-nixbot> Finished executing pypaInstallPhase55python3.13-nixbot> Running phase: pythonOutputDistPhase56python3.13-nixbot> Executing pythonOutputDistPhase57python3.13-nixbot> Finished executing pythonOutputDistPhase58python3.13-nixbot> Running phase: fixupPhase59python3.13-nixbot> shrinking RPATHs of ELF executables and libraries in /nix/store/3ziq2fcwi2happk9hcqacyinq2vqmlw3-python3.13-nixbot60python3.13-nixbot> checking for references to /build/ in /nix/store/3ziq2fcwi2happk9hcqacyinq2vqmlw3-python3.13-nixbot...61python3.13-nixbot> patching script interpreter paths in /nix/store/3ziq2fcwi2happk9hcqacyinq2vqmlw3-python3.13-nixbot62python3.13-nixbot> stripping (with command strip and flags -S -p) in  /nix/store/3ziq2fcwi2happk9hcqacyinq2vqmlw3-python3.13-nixbot/lib /nix/store/3ziq2fcwi2happk9hcqacyinq2vqmlw3-python3.13-nixbot/bin63python3.13-nixbot> shrinking RPATHs of ELF executables and libraries in /nix/store/1h3imnqy9c17q3m0qpfznppwjvwkmniz-python3.13-nixbot-dist64python3.13-nixbot> checking for references to /build/ in /nix/store/1h3imnqy9c17q3m0qpfznppwjvwkmniz-python3.13-nixbot-dist...65python3.13-nixbot> patching script interpreter paths in /nix/store/1h3imnqy9c17q3m0qpfznppwjvwkmniz-python3.13-nixbot-dist66python3.13-nixbot> Rewriting #!/nix/store/lqn6mbgzzdrqq2qkwddcmxj9z6amdd86-python3-3.13.13/bin/python3.13 to #!/nix/store/lqn6mbgzzdrqq2qkwddcmxj9z6amdd86-python3-3.13.1367python3.13-nixbot> wrapping `/nix/store/3ziq2fcwi2happk9hcqacyinq2vqmlw3-python3.13-nixbot/bin/nixbot'...68python3.13-nixbot> Executing pythonRemoveTestsDir69python3.13-nixbot> Finished executing pythonRemoveTestsDir70python3.13-nixbot> Running phase: pythonCatchConflictsPhase71python3.13-nixbot> Running phase: pythonRemoveBinBytecodePhase72python3.13-nixbot> Running phase: pythonImportsCheckPhase73python3.13-nixbot> Executing pythonImportsCheckPhase74building '/nix/store/l0crcd7l1s9chx3w2ssaqrgpn03lbp2c-unit-nixbot.service.drv' on 'ssh-ng://nix@eliza'75building '/nix/store/l0crcd7l1s9chx3w2ssaqrgpn03lbp2c-unit-nixbot.service.drv'76building '/nix/store/aanb56a48v1xkj3ga5w2q1gf2nppmkql-system-units.drv' on 'ssh-ng://nix@eliza'77building '/nix/store/aanb56a48v1xkj3ga5w2q1gf2nppmkql-system-units.drv'78building '/nix/store/xw1v9v9g1h9zs0529xr64iwp2bc42wv7-etc.drv' on 'ssh-ng://nix@eliza'79building '/nix/store/xw1v9v9g1h9zs0529xr64iwp2bc42wv7-etc.drv'80building '/nix/store/azdkh5g52nr5ndvf2i6d06l8x18697fs-activate.drv' on 'ssh-ng://nix@eliza'81building '/nix/store/azdkh5g52nr5ndvf2i6d06l8x18697fs-activate.drv'82building '/nix/store/i1sddng8nl4znkhwxhs3g3kaiclh3xn8-nixos-system-gitlab-test.drv' on 'ssh-ng://nix@eliza'83building '/nix/store/i1sddng8nl4znkhwxhs3g3kaiclh3xn8-nixos-system-gitlab-test.drv'84nixos-system-gitlab-test> structuredAttrs is enabled85building '/nix/store/ymp56b5pb7yim0jfcqm9ywrr3pydzjih-closure-info.drv' on 'ssh-ng://nix@eliza'86building '/nix/store/ymp56b5pb7yim0jfcqm9ywrr3pydzjih-closure-info.drv'87closure-info> structuredAttrs is enabled88building '/nix/store/q2jw38d53gd79pf43kdzh9a8qpw9jw3l-closure-info.drv' on 'ssh-ng://nix@eliza'89building '/nix/store/q2jw38d53gd79pf43kdzh9a8qpw9jw3l-closure-info.drv'90closure-info> structuredAttrs is enabled91building '/nix/store/fyv9jpcn05qwzqk76r6gzw82415fsirh-run-nixos-vm.drv' on 'ssh-ng://nix@eliza'92building '/nix/store/fyv9jpcn05qwzqk76r6gzw82415fsirh-run-nixos-vm.drv'93building '/nix/store/ciyr41amn7854g2wjbsq2b1vc8g0scry-nixos-vm.drv' on 'ssh-ng://nix@eliza'94building '/nix/store/ciyr41amn7854g2wjbsq2b1vc8g0scry-nixos-vm.drv'95building '/nix/store/8jwr29px7k36d8faqfq7dj5ay0bv1ncr-driverConfiguration.json.drv' on 'ssh-ng://nix@eliza'96building '/nix/store/8jwr29px7k36d8faqfq7dj5ay0bv1ncr-driverConfiguration.json.drv'97driverConfiguration.json> structuredAttrs is enabled98building '/nix/store/33ixl7d8nrkgl1qycw9vw2r54n2i3igb-nixos-test-driver-nixbot-gitlab.drv' on 'ssh-ng://nix@eliza'99building '/nix/store/33ixl7d8nrkgl1qycw9vw2r54n2i3igb-nixos-test-driver-nixbot-gitlab.drv'100nixos-test-driver-nixbot-gitlab> Running type check (enable/disable: config.skipTypeCheck)101nixos-test-driver-nixbot-gitlab> See https://nixos.org/manual/nixos/stable/#test-opt-skipTypeCheck102nixos-test-driver-nixbot-gitlab> All checks passed!103nixos-test-driver-nixbot-gitlab> Linting test script (enable/disable: config.skipLint)104nixos-test-driver-nixbot-gitlab> See https://nixos.org/manual/nixos/stable/#test-opt-skipLint105nixos-test-driver-nixbot-gitlab> All checks passed!106building '/nix/store/h8vyj0ydy4la4xqdz2i7p49pydf7zs7v-vm-test-run-nixbot-gitlab.drv' on 'ssh-ng://nix@eliza'107building '/nix/store/h8vyj0ydy4la4xqdz2i7p49pydf7zs7v-vm-test-run-nixbot-gitlab.drv'108vm-test-run-nixbot-gitlab> Machine state will be reset. To keep it, pass --keep-machine-state109vm-test-run-nixbot-gitlab> start all VLans110vm-test-run-nixbot-gitlab> (finished: start all VLans, in 0.00 seconds)111vm-test-run-nixbot-gitlab> Test will time out and terminate in 3600 seconds112vm-test-run-nixbot-gitlab> run the VM test script113vm-test-run-nixbot-gitlab> additionally exposed symbols:114vm-test-run-nixbot-gitlab>     gitlab,115vm-test-run-nixbot-gitlab>     vlan1,116vm-test-run-nixbot-gitlab>     start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh117vm-test-run-nixbot-gitlab> start all VMs118vm-test-run-nixbot-gitlab> gitlab: starting vm119vm-test-run-nixbot-gitlab> gitlab: QEMU running (pid 13)120vm-test-run-nixbot-gitlab> gitlab # Disk image does not exist, creating the virtualisation disk image...121vm-test-run-nixbot-gitlab> gitlab # Formatting '/build/vm-state-gitlab/tmp.Sq3WsUrBjv', fmt=raw size=1073741824122vm-test-run-nixbot-gitlab> gitlab # mke2fs 1.47.3 (8-Jul-2025)123vm-test-run-nixbot-gitlab> gitlab # Discarding device blocks:      0/262144             done124vm-test-run-nixbot-gitlab> gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes125vm-test-run-nixbot-gitlab> gitlab # Filesystem UUID: 2508b259-92d8-4b15-8b68-bcdee2435ec1126vm-test-run-nixbot-gitlab> gitlab # Superblock backups stored on blocks:127vm-test-run-nixbot-gitlab> gitlab # 	32768, 98304, 163840, 229376128vm-test-run-nixbot-gitlab> gitlab # 129vm-test-run-nixbot-gitlab> gitlab # Allocating group tables: 0/8   done130vm-test-run-nixbot-gitlab> gitlab # Writing inode tables: 0/8   done131vm-test-run-nixbot-gitlab> gitlab # Creating journal (8192 blocks): done132vm-test-run-nixbot-gitlab> gitlab # Writing superblocks and filesystem accounting information: 0/8   done133vm-test-run-nixbot-gitlab> gitlab # 134vm-test-run-nixbot-gitlab> gitlab # Virtualisation disk image created.135vm-test-run-nixbot-gitlab> gitlab # Creating Nix store image...136vm-test-run-nixbot-gitlab> gitlab # Created Nix store image.137vm-test-run-nixbot-gitlab> (finished: start all VMs, in 63.60 seconds)138vm-test-run-nixbot-gitlab> gitlab: waiting for unit setup-gitlab.service139vm-test-run-nixbot-gitlab> gitlab: waiting for the VM to finish booting140vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]141vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Jun  1 15:51:08 UTC 2026142vm-test-run-nixbot-gitlab> gitlab # [    0.000000] KASLR enabled143vm-test-run-nixbot-gitlab> gitlab # [    0.000000] random: crng init done144vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Machine model: linux,dummy-virt145vm-test-run-nixbot-gitlab> gitlab # [    0.000000] efi: UEFI not found.146vm-test-run-nixbot-gitlab> gitlab # [    0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT147vm-test-run-nixbot-gitlab> gitlab # [    0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]148vm-test-run-nixbot-gitlab> gitlab # [    0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]149vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Zone ranges:150vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   DMA      [mem 0x0000000040000000-0x00000000ffffffff]151vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   DMA32    empty152vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   Normal   [mem 0x0000000100000000-0x00000001bfffffff]153vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   Device   empty154vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Movable zone start for each node155vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Early memory node ranges156vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   node   0: [mem 0x0000000040000000-0x00000001bfffffff]157vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]158vm-test-run-nixbot-gitlab> gitlab # [    0.000000] cma: Reserved 32 MiB at 0x00000000fe000000159vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: probing for conduit method from DT.160vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: PSCIv1.3 detected in firmware.161vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: Using standard PSCI v0.2 function IDs162vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: Trusted OS migration not required163vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: SMC Calling Convention v1.1164vm-test-run-nixbot-gitlab> gitlab # [    0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)165vm-test-run-nixbot-gitlab> gitlab # [    0.000000] percpu: Embedded 76 pages/cpu s185944 r8192 d117160 u311296166vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Detected PIPT I-cache on CPU0167vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)168vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: GICv3 CPU interface169vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: Spectre-v4170vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: Spectre-BHB171vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38172vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23173vm-test-run-nixbot-gitlab> gitlab # [    0.000000] alternatives: applying boot alternatives174vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/y4gn0sc342na7svj38rb3db5nim07hwx-nixos-system-gitlab-test/init regInfo=/nix/store/p35nn984avv1vxbhvmdj0whjxg3msh2w-closure-info/registration console=ttyAMA0,115200n8 console=tty0175vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Unknown kernel command line parameters "regInfo=/nix/store/p35nn984avv1vxbhvmdj0whjxg3msh2w-closure-info/registration", will be passed to user space.176vm-test-run-nixbot-gitlab> gitlab # [    0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes177vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)178vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)179vm-test-run-nixbot-gitlab> gitlab # [    0.000000] software IO TLB: area num 4.180vm-test-run-nixbot-gitlab> gitlab # [    0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)181vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Fallback order for Node 0: 0182vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 1572864183vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Policy zone: Normal184vm-test-run-nixbot-gitlab> gitlab # [    0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off185vm-test-run-nixbot-gitlab> gitlab # [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1186vm-test-run-nixbot-gitlab> gitlab # [    0.000000] allocated 12582912 bytes of page_ext187vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ftrace: allocating 74648 entries in 292 pages188vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ftrace: allocated 292 pages with 3 groups189vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: Hierarchical RCU implementation.190vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: 	RCU event tracing is enabled.191vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.192vm-test-run-nixbot-gitlab> gitlab # [    0.000000] 	Trampoline variant of Tasks RCU enabled.193vm-test-run-nixbot-gitlab> gitlab # [    0.000000] 	Rude variant of Tasks RCU enabled.194vm-test-run-nixbot-gitlab> gitlab # [    0.000000] 	Tracing variant of Tasks RCU enabled.195vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.196vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4197vm-test-run-nixbot-gitlab> gitlab # [    0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.198vm-test-run-nixbot-gitlab> gitlab # [    0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.199vm-test-run-nixbot-gitlab> gitlab # [    0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.200vm-test-run-nixbot-gitlab> gitlab # [    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0201vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: 256 SPIs implemented202vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: 0 Extended SPIs implemented203vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Root IRQ handler: gic_handle_irq204vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI205vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0206vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000207vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ITS [mem 0x08080000-0x0809ffff]208vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f00000 (indirect, esz 8, psz 64K, shr 1)209vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f10000 (flat, esz 8, psz 64K, shr 1)210vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: using LPI property table @0x0000000100f20000211vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f30000212vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.213vm-test-run-nixbot-gitlab> gitlab # [    0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).214vm-test-run-nixbot-gitlab> gitlab # [    0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns215vm-test-run-nixbot-gitlab> gitlab # [    0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns216vm-test-run-nixbot-gitlab> gitlab # [    0.000028] arm-pv: using stolen time PV217vm-test-run-nixbot-gitlab> gitlab # [    0.000367] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)218vm-test-run-nixbot-gitlab> gitlab # [    0.000535] Console: colour dummy device 80x25219vm-test-run-nixbot-gitlab> gitlab # [    0.000542] printk: legacy console [tty0] enabled220vm-test-run-nixbot-gitlab> gitlab # [    0.000723] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)221vm-test-run-nixbot-gitlab> gitlab # [    0.000730] pid_max: default: 32768 minimum: 301222vm-test-run-nixbot-gitlab> gitlab # [    0.000807] LSM: initializing lsm=capability,landlock,yama,bpf,ima223vm-test-run-nixbot-gitlab> gitlab # [    0.000973] landlock: Up and running.224vm-test-run-nixbot-gitlab> gitlab # [    0.000976] Yama: becoming mindful.225vm-test-run-nixbot-gitlab> gitlab # [    0.001365] LSM support for eBPF active226vm-test-run-nixbot-gitlab> gitlab # [    0.001563] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)227vm-test-run-nixbot-gitlab> gitlab # [    0.001655] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)228vm-test-run-nixbot-gitlab> gitlab # [    0.002793] cacheinfo: Unable to detect cache hierarchy for CPU 0229vm-test-run-nixbot-gitlab> gitlab # [    0.003431] rcu: Hierarchical SRCU implementation.230vm-test-run-nixbot-gitlab> gitlab # [    0.003435] rcu: 	Max phase no-delay instances is 1000.231vm-test-run-nixbot-gitlab> gitlab # [    0.003570] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level232vm-test-run-nixbot-gitlab> gitlab # [    0.004546] fsl-mc MSI: its@8080000 domain created233vm-test-run-nixbot-gitlab> gitlab # [    0.004639] EFI services will not be available.234vm-test-run-nixbot-gitlab> gitlab # [    0.004800] smp: Bringing up secondary CPUs ...235vm-test-run-nixbot-gitlab> gitlab # [    0.005380] Detected PIPT I-cache on CPU1236vm-test-run-nixbot-gitlab> gitlab # [    0.005477] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000237vm-test-run-nixbot-gitlab> gitlab # [    0.005596] GICv3: CPU1: using allocated LPI pending table @0x0000000100f40000238vm-test-run-nixbot-gitlab> gitlab # [    0.005718] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]239vm-test-run-nixbot-gitlab> gitlab # [    0.006701] Detected PIPT I-cache on CPU2240vm-test-run-nixbot-gitlab> gitlab # [    0.006882] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000241vm-test-run-nixbot-gitlab> gitlab # [    0.007002] GICv3: CPU2: using allocated LPI pending table @0x0000000100f50000242vm-test-run-nixbot-gitlab> gitlab # [    0.007130] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]243vm-test-run-nixbot-gitlab> gitlab # [    0.008093] Detected PIPT I-cache on CPU3244vm-test-run-nixbot-gitlab> gitlab # [    0.008208] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000245vm-test-run-nixbot-gitlab> gitlab # [    0.008328] GICv3: CPU3: using allocated LPI pending table @0x0000000100f60000246vm-test-run-nixbot-gitlab> gitlab # [    0.008452] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]247vm-test-run-nixbot-gitlab> gitlab # [    0.008925] smp: Brought up 1 node, 4 CPUs248vm-test-run-nixbot-gitlab> gitlab # [    0.008951] SMP: Total of 4 processors activated.249vm-test-run-nixbot-gitlab> gitlab # [    0.008954] CPU: All CPU(s) started at EL1250vm-test-run-nixbot-gitlab> gitlab # [    0.008962] CPU features: detected: Branch Target Identification251vm-test-run-nixbot-gitlab> gitlab # [    0.008966] CPU features: detected: ARMv8.4 Translation Table Level252vm-test-run-nixbot-gitlab> gitlab # [    0.008969] CPU features: detected: Instruction cache invalidation not required for I/D coherence253vm-test-run-nixbot-gitlab> gitlab # [    0.008972] CPU features: detected: Data cache clean to the PoU not required for I/D coherence254vm-test-run-nixbot-gitlab> gitlab # [    0.008975] CPU features: detected: Common not Private translations255vm-test-run-nixbot-gitlab> gitlab # [    0.008978] CPU features: detected: CRC32 instructions256vm-test-run-nixbot-gitlab> gitlab # [    0.008981] CPU features: detected: Data cache clean to Point of Deep Persistence257vm-test-run-nixbot-gitlab> gitlab # [    0.008984] CPU features: detected: Data cache clean to Point of Persistence258vm-test-run-nixbot-gitlab> gitlab # [    0.008986] CPU features: detected: Data independent timing control (DIT)259vm-test-run-nixbot-gitlab> gitlab # [    0.008989] CPU features: detected: E0PD260vm-test-run-nixbot-gitlab> gitlab # [    0.008991] CPU features: detected: Enhanced Counter Virtualization261vm-test-run-nixbot-gitlab> gitlab # [    0.008994] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)262vm-test-run-nixbot-gitlab> gitlab # [    0.008997] CPU features: detected: Enhanced Virtualization Traps263vm-test-run-nixbot-gitlab> gitlab # [    0.008999] CPU features: detected: Fine Grained Traps264vm-test-run-nixbot-gitlab> gitlab # [    0.009002] CPU features: detected: Generic authentication (architected QARMA5 algorithm)265vm-test-run-nixbot-gitlab> gitlab # [    0.009006] CPU features: detected: RCpc load-acquire (LDAPR)266vm-test-run-nixbot-gitlab> gitlab # [    0.009009] CPU features: detected: LSE atomic instructions267vm-test-run-nixbot-gitlab> gitlab # [    0.009011] CPU features: detected: Privileged Access Never268vm-test-run-nixbot-gitlab> gitlab # [    0.009014] CPU features: detected: PMUv3269vm-test-run-nixbot-gitlab> gitlab # [    0.009016] CPU features: detected: RAS Extension Support270vm-test-run-nixbot-gitlab> gitlab # [    0.009018] CPU features: detected: RASv1p1 Extension Support271vm-test-run-nixbot-gitlab> gitlab # [    0.009021] CPU features: detected: Random Number Generator272vm-test-run-nixbot-gitlab> gitlab # [    0.009023] CPU features: detected: Speculation barrier (SB)273vm-test-run-nixbot-gitlab> gitlab # [    0.009025] CPU features: detected: Stage-2 Force Write-Back274vm-test-run-nixbot-gitlab> gitlab # [    0.009028] CPU features: detected: TLB range maintenance instructions275vm-test-run-nixbot-gitlab> gitlab # [    0.009031] CPU features: detected: Speculative Store Bypassing Safe (SSBS)276vm-test-run-nixbot-gitlab> gitlab # [    0.009170] alternatives: applying system-wide alternatives277vm-test-run-nixbot-gitlab> gitlab # [    0.012074] CPU features: detected: BBM Level 2 without TLB conflict abort278vm-test-run-nixbot-gitlab> gitlab # [    0.012295] Memory: 5965848K/6291456K available (24320K kernel code, 7086K rwdata, 26308K rodata, 4736K init, 1102K bss, 270904K reserved, 32768K cma-reserved)279vm-test-run-nixbot-gitlab> gitlab # [    0.013665] devtmpfs: initialized280vm-test-run-nixbot-gitlab> gitlab # [    0.017435] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns281vm-test-run-nixbot-gitlab> gitlab # [    0.017480] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)282vm-test-run-nixbot-gitlab> gitlab # [    0.017535] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).283vm-test-run-nixbot-gitlab> gitlab # [    0.017721] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL284vm-test-run-nixbot-gitlab> gitlab # [    0.017725] 0 pages in range for non-PLT usage285vm-test-run-nixbot-gitlab> gitlab # [    0.017727] 508336 pages in range for PLT usage286vm-test-run-nixbot-gitlab> gitlab # [    0.017866] pinctrl core: initialized pinctrl subsystem287vm-test-run-nixbot-gitlab> gitlab # [    0.018661] DMI not present or invalid.288vm-test-run-nixbot-gitlab> gitlab # [    0.021659] NET: Registered PF_NETLINK/PF_ROUTE protocol family289vm-test-run-nixbot-gitlab> gitlab # [    0.024200] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations290vm-test-run-nixbot-gitlab> gitlab # [    0.024467] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations291vm-test-run-nixbot-gitlab> gitlab # [    0.026089] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations292vm-test-run-nixbot-gitlab> gitlab # [    0.026110] audit: initializing netlink subsys (disabled)293vm-test-run-nixbot-gitlab> gitlab # [    0.026405] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1294vm-test-run-nixbot-gitlab> gitlab # [    0.026877] thermal_sys: Registered thermal governor 'fair_share'295vm-test-run-nixbot-gitlab> gitlab # [    0.026881] thermal_sys: Registered thermal governor 'bang_bang'296vm-test-run-nixbot-gitlab> gitlab # [    0.026885] thermal_sys: Registered thermal governor 'step_wise'297vm-test-run-nixbot-gitlab> gitlab # [    0.026888] thermal_sys: Registered thermal governor 'user_space'298vm-test-run-nixbot-gitlab> gitlab # [    0.026890] thermal_sys: Registered thermal governor 'power_allocator'299vm-test-run-nixbot-gitlab> gitlab # [    0.026970] cpuidle: using governor ladder300vm-test-run-nixbot-gitlab> gitlab # [    0.026994] cpuidle: using governor menu301vm-test-run-nixbot-gitlab> gitlab # [    0.027192] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.302vm-test-run-nixbot-gitlab> gitlab # [    0.027402] ASID allocator initialised with 65536 entries303vm-test-run-nixbot-gitlab> gitlab # [    0.028539] Serial: AMBA PL011 UART driver304vm-test-run-nixbot-gitlab> gitlab # [    0.033550] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1305vm-test-run-nixbot-gitlab> gitlab # [    0.033891] printk: console [ttyAMA0] enabled306vm-test-run-nixbot-gitlab> gitlab # [    0.044386] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages307vm-test-run-nixbot-gitlab> gitlab # [    0.044407] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page308vm-test-run-nixbot-gitlab> gitlab # [    0.044416] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages309vm-test-run-nixbot-gitlab> gitlab # [    0.044424] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page310vm-test-run-nixbot-gitlab> gitlab # [    0.044433] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages311vm-test-run-nixbot-gitlab> gitlab # [    0.044441] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page312vm-test-run-nixbot-gitlab> gitlab # [    0.044449] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages313vm-test-run-nixbot-gitlab> gitlab # [    0.044457] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page314vm-test-run-nixbot-gitlab> gitlab # [    0.056761] fbcon: Taking over console315vm-test-run-nixbot-gitlab> gitlab # [    0.056787] ACPI: Interpreter disabled.316vm-test-run-nixbot-gitlab> gitlab # [    0.059706] iommu: Default domain type: Translated317vm-test-run-nixbot-gitlab> gitlab # [    0.059719] iommu: DMA domain TLB invalidation policy: strict mode318vm-test-run-nixbot-gitlab> gitlab # [    0.069844] SCSI subsystem initialized319vm-test-run-nixbot-gitlab> gitlab # [    0.070635] usbcore: registered new interface driver usbfs320vm-test-run-nixbot-gitlab> gitlab # [    0.070700] usbcore: registered new interface driver hub321vm-test-run-nixbot-gitlab> gitlab # [    0.070743] usbcore: registered new device driver usb322vm-test-run-nixbot-gitlab> gitlab # [    0.071537] pps_core: LinuxPPS API ver. 1 registered323vm-test-run-nixbot-gitlab> gitlab # [    0.071548] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>324vm-test-run-nixbot-gitlab> gitlab # [    0.071569] PTP clock support registered325vm-test-run-nixbot-gitlab> gitlab # [    0.071668] EDAC MC: Ver: 3.0.0326vm-test-run-nixbot-gitlab> gitlab # [    0.072354] scmi_core: SCMI protocol bus registered327vm-test-run-nixbot-gitlab> gitlab # [    0.073506] FPGA manager framework328vm-test-run-nixbot-gitlab> gitlab # [    0.075316] vgaarb: loaded329vm-test-run-nixbot-gitlab> gitlab # [    0.077365] clocksource: Switched to clocksource arch_sys_counter330vm-test-run-nixbot-gitlab> gitlab # [    0.080211] VFS: Disk quotas dquot_6.6.0331vm-test-run-nixbot-gitlab> gitlab # [    0.080271] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)332vm-test-run-nixbot-gitlab> gitlab # [    0.081143] netfs: FS-Cache loaded333vm-test-run-nixbot-gitlab> gitlab # [    0.081405] pnp: PnP ACPI: disabled334vm-test-run-nixbot-gitlab> gitlab # [    0.089952] NET: Registered PF_INET protocol family335vm-test-run-nixbot-gitlab> gitlab # [    0.092119] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)336vm-test-run-nixbot-gitlab> gitlab # [    0.145891] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)337vm-test-run-nixbot-gitlab> gitlab # [    0.145961] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)338vm-test-run-nixbot-gitlab> gitlab # [    0.146020] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)339vm-test-run-nixbot-gitlab> gitlab # [    0.146443] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)340vm-test-run-nixbot-gitlab> gitlab # [    0.147281] TCP: Hash tables configured (established 65536 bind 65536)341vm-test-run-nixbot-gitlab> gitlab # [    0.147425] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)342vm-test-run-nixbot-gitlab> gitlab # [    0.147493] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)343vm-test-run-nixbot-gitlab> gitlab # [    0.147668] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)344vm-test-run-nixbot-gitlab> gitlab # [    0.147895] NET: Registered PF_UNIX/PF_LOCAL protocol family345vm-test-run-nixbot-gitlab> gitlab # [    0.147916] NET: Registered PF_XDP protocol family346vm-test-run-nixbot-gitlab> gitlab # [    0.147936] PCI: CLS 0 bytes, default 64347vm-test-run-nixbot-gitlab> gitlab # [    0.148167] Trying to unpack rootfs image as initramfs...348vm-test-run-nixbot-gitlab> gitlab # [    0.161913] kvm [1]: HYP mode not available349vm-test-run-nixbot-gitlab> gitlab # [    0.234167] Initialise system trusted keyrings350vm-test-run-nixbot-gitlab> gitlab # [    0.234457] workingset: timestamp_bits=42 max_order=21 bucket_order=0351vm-test-run-nixbot-gitlab> gitlab # [    0.237700] squashfs: version 4.0 (2009/01/31) Phillip Lougher352vm-test-run-nixbot-gitlab> gitlab # [    0.237784] 9p: Installing v9fs 9p2000 file system support353vm-test-run-nixbot-gitlab> gitlab # [    0.253029] Key type asymmetric registered354vm-test-run-nixbot-gitlab> gitlab # [    0.253034] Asymmetric key parser 'x509' registered355vm-test-run-nixbot-gitlab> gitlab # [    0.253096] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)356vm-test-run-nixbot-gitlab> gitlab # [    0.253323] io scheduler mq-deadline registered357vm-test-run-nixbot-gitlab> gitlab # [    0.253329] io scheduler kyber registered358vm-test-run-nixbot-gitlab> gitlab # [    0.263573] pl061_gpio 9030000.pl061: PL061 GPIO chip registered359vm-test-run-nixbot-gitlab> gitlab # [    0.266360] ledtrig-cpu: registered to indicate activity on CPUs360vm-test-run-nixbot-gitlab> gitlab # [    0.266953] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:361vm-test-run-nixbot-gitlab> gitlab # [    0.266976] pci-host-generic 4010000000.pcie:       IO 0x003eff0000..0x003effffff -> 0x0000000000362vm-test-run-nixbot-gitlab> gitlab # [    0.266992] pci-host-generic 4010000000.pcie:      MEM 0x0010000000..0x003efeffff -> 0x0010000000363vm-test-run-nixbot-gitlab> gitlab # [    0.267002] pci-host-generic 4010000000.pcie:      MEM 0x8000000000..0xffffffffff -> 0x8000000000364vm-test-run-nixbot-gitlab> gitlab # [    0.267031] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits365vm-test-run-nixbot-gitlab> gitlab # [    0.267063] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]366vm-test-run-nixbot-gitlab> gitlab # [    0.267193] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00367vm-test-run-nixbot-gitlab> gitlab # [    0.267205] pci_bus 0000:00: root bus resource [bus 00-ff]368vm-test-run-nixbot-gitlab> gitlab # [    0.267211] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]369vm-test-run-nixbot-gitlab> gitlab # [    0.267216] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]370vm-test-run-nixbot-gitlab> gitlab # [    0.267222] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]371vm-test-run-nixbot-gitlab> gitlab # [    0.267321] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint372vm-test-run-nixbot-gitlab> gitlab # [    0.268185] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint373vm-test-run-nixbot-gitlab> gitlab # [    0.268551] pci 0000:00:01.0: BAR 0 [io  0x0000-0x001f]374vm-test-run-nixbot-gitlab> gitlab # [    0.268571] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]375vm-test-run-nixbot-gitlab> gitlab # [    0.268622] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]376vm-test-run-nixbot-gitlab> gitlab # [    0.268643] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]377vm-test-run-nixbot-gitlab> gitlab # [    0.269513] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint378vm-test-run-nixbot-gitlab> gitlab # [    0.269901] pci 0000:00:02.0: BAR 0 [io  0x0000-0x001f]379vm-test-run-nixbot-gitlab> gitlab # [    0.269921] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]380vm-test-run-nixbot-gitlab> gitlab # [    0.269971] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]381vm-test-run-nixbot-gitlab> gitlab # [    0.270865] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint382vm-test-run-nixbot-gitlab> gitlab # [    0.271225] pci 0000:00:03.0: BAR 0 [io  0x0000-0x001f]383vm-test-run-nixbot-gitlab> gitlab # [    0.271244] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]384vm-test-run-nixbot-gitlab> gitlab # [    0.271289] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]385vm-test-run-nixbot-gitlab> gitlab # [    0.272161] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint386vm-test-run-nixbot-gitlab> gitlab # [    0.272542] pci 0000:00:04.0: BAR 0 [io  0x0000-0x001f]387vm-test-run-nixbot-gitlab> gitlab # [    0.272569] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]388vm-test-run-nixbot-gitlab> gitlab # [    0.272619] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]389vm-test-run-nixbot-gitlab> gitlab # [    0.273509] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint390vm-test-run-nixbot-gitlab> gitlab # [    0.273855] pci 0000:00:05.0: BAR 0 [io  0x0000-0x007f]391vm-test-run-nixbot-gitlab> gitlab # [    0.273875] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]392vm-test-run-nixbot-gitlab> gitlab # [    0.273932] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]393vm-test-run-nixbot-gitlab> gitlab # [    0.274812] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint394vm-test-run-nixbot-gitlab> gitlab # [    0.275175] pci 0000:00:06.0: BAR 0 [io  0x0000-0x007f]395vm-test-run-nixbot-gitlab> gitlab # [    0.275196] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]396vm-test-run-nixbot-gitlab> gitlab # [    0.275238] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]397vm-test-run-nixbot-gitlab> gitlab # [    0.276120] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint398vm-test-run-nixbot-gitlab> gitlab # [    0.276467] pci 0000:00:07.0: BAR 0 [io  0x0000-0x001f]399vm-test-run-nixbot-gitlab> gitlab # [    0.276487] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]400vm-test-run-nixbot-gitlab> gitlab # [    0.276538] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]401vm-test-run-nixbot-gitlab> gitlab # [    0.276558] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]402vm-test-run-nixbot-gitlab> gitlab # [    0.277493] pci 0000:00:08.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint403vm-test-run-nixbot-gitlab> gitlab # [    0.277858] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]404vm-test-run-nixbot-gitlab> gitlab # [    0.277902] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]405vm-test-run-nixbot-gitlab> gitlab # [    0.278777] pci 0000:00:09.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint406vm-test-run-nixbot-gitlab> gitlab # [    0.279152] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]407vm-test-run-nixbot-gitlab> gitlab # [    0.279202] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]408vm-test-run-nixbot-gitlab> gitlab # [    0.279948] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint409vm-test-run-nixbot-gitlab> gitlab # [    0.280344] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]410vm-test-run-nixbot-gitlab> gitlab # [    0.280813] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint411vm-test-run-nixbot-gitlab> gitlab # [    0.281231] pci 0000:00:0b.0: BAR 0 [io  0x0000-0x003f]412vm-test-run-nixbot-gitlab> gitlab # [    0.281250] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]413vm-test-run-nixbot-gitlab> gitlab # [    0.281301] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]414vm-test-run-nixbot-gitlab> gitlab # [    0.282159] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint415vm-test-run-nixbot-gitlab> gitlab # [    0.282560] pci 0000:00:0c.0: BAR 0 [io  0x0000-0x001f]416vm-test-run-nixbot-gitlab> gitlab # [    0.282579] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]417vm-test-run-nixbot-gitlab> gitlab # [    0.282630] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]418vm-test-run-nixbot-gitlab> gitlab # [    0.283723] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned419vm-test-run-nixbot-gitlab> gitlab # [    0.283733] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned420vm-test-run-nixbot-gitlab> gitlab # [    0.283739] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned421vm-test-run-nixbot-gitlab> gitlab # [    0.283818] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned422vm-test-run-nixbot-gitlab> gitlab # [    0.283907] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned423vm-test-run-nixbot-gitlab> gitlab # [    0.283979] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned424vm-test-run-nixbot-gitlab> gitlab # [    0.284051] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned425vm-test-run-nixbot-gitlab> gitlab # [    0.284136] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned426vm-test-run-nixbot-gitlab> gitlab # [    0.284215] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned427vm-test-run-nixbot-gitlab> gitlab # [    0.284289] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned428vm-test-run-nixbot-gitlab> gitlab # [    0.284362] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned429vm-test-run-nixbot-gitlab> gitlab # [    0.284434] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned430vm-test-run-nixbot-gitlab> gitlab # [    0.284549] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned431vm-test-run-nixbot-gitlab> gitlab # [    0.284620] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned432vm-test-run-nixbot-gitlab> gitlab # [    0.284648] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned433vm-test-run-nixbot-gitlab> gitlab # [    0.284681] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned434vm-test-run-nixbot-gitlab> gitlab # [    0.284709] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned435vm-test-run-nixbot-gitlab> gitlab # [    0.284743] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned436vm-test-run-nixbot-gitlab> gitlab # [    0.284772] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned437vm-test-run-nixbot-gitlab> gitlab # [    0.284800] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned438vm-test-run-nixbot-gitlab> gitlab # [    0.284828] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned439vm-test-run-nixbot-gitlab> gitlab # [    0.284863] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned440vm-test-run-nixbot-gitlab> gitlab # [    0.284897] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned441vm-test-run-nixbot-gitlab> gitlab # [    0.284926] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned442vm-test-run-nixbot-gitlab> gitlab # [    0.284955] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned443vm-test-run-nixbot-gitlab> gitlab # [    0.284983] pci 0000:00:05.0: BAR 0 [io  0x1000-0x107f]: assigned444vm-test-run-nixbot-gitlab> gitlab # [    0.285010] pci 0000:00:06.0: BAR 0 [io  0x1080-0x10ff]: assigned445vm-test-run-nixbot-gitlab> gitlab # [    0.285037] pci 0000:00:0b.0: BAR 0 [io  0x1100-0x113f]: assigned446vm-test-run-nixbot-gitlab> gitlab # [    0.285064] pci 0000:00:01.0: BAR 0 [io  0x1140-0x115f]: assigned447vm-test-run-nixbot-gitlab> gitlab # [    0.285091] pci 0000:00:02.0: BAR 0 [io  0x1160-0x117f]: assigned448vm-test-run-nixbot-gitlab> gitlab # [    0.285119] pci 0000:00:03.0: BAR 0 [io  0x1180-0x119f]: assigned449vm-test-run-nixbot-gitlab> gitlab # [    0.285146] pci 0000:00:04.0: BAR 0 [io  0x11a0-0x11bf]: assigned450vm-test-run-nixbot-gitlab> gitlab # [    0.285174] pci 0000:00:07.0: BAR 0 [io  0x11c0-0x11df]: assigned451vm-test-run-nixbot-gitlab> gitlab # [    0.285202] pci 0000:00:0c.0: BAR 0 [io  0x11e0-0x11ff]: assigned452vm-test-run-nixbot-gitlab> gitlab # [    0.285243] pci_bus 0000:00: resource 4 [io  0x0000-0xffff]453vm-test-run-nixbot-gitlab> gitlab # [    0.285251] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]454vm-test-run-nixbot-gitlab> gitlab # [    0.285256] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]455vm-test-run-nixbot-gitlab> gitlab # [    0.287492] pci 0000:00:0a.0: enabling device (0000 -> 0002)456vm-test-run-nixbot-gitlab> gitlab # [    0.305469] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)457vm-test-run-nixbot-gitlab> gitlab # [    0.308179] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)458vm-test-run-nixbot-gitlab> gitlab # [    0.310875] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)459vm-test-run-nixbot-gitlab> gitlab # [    0.313856] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)460vm-test-run-nixbot-gitlab> gitlab # [    0.319606] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)461vm-test-run-nixbot-gitlab> gitlab # [    0.322308] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)462vm-test-run-nixbot-gitlab> gitlab # [    0.325055] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)463vm-test-run-nixbot-gitlab> gitlab # [    0.327751] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)464vm-test-run-nixbot-gitlab> gitlab # [    0.333186] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)465vm-test-run-nixbot-gitlab> gitlab # [    0.336313] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)466vm-test-run-nixbot-gitlab> gitlab # [    0.339167] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)467vm-test-run-nixbot-gitlab> gitlab # [    0.345692] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled468vm-test-run-nixbot-gitlab> gitlab # [    0.347941] msm_serial: driver initialized469vm-test-run-nixbot-gitlab> gitlab # [    0.348111] SuperH (H)SCI(F) driver initialized470vm-test-run-nixbot-gitlab> gitlab # [    0.348189] STM32 USART driver initialized471vm-test-run-nixbot-gitlab> gitlab # [    0.370143] loop: module loaded472vm-test-run-nixbot-gitlab> gitlab # [    0.370375] virtio_blk virtio4: 4/0/0 default/read/poll queues473vm-test-run-nixbot-gitlab> gitlab # [    0.372460] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)474vm-test-run-nixbot-gitlab> gitlab # [    0.374660] virtio_blk virtio5: 4/0/0 default/read/poll queues475vm-test-run-nixbot-gitlab> gitlab # [    0.376826] virtio_blk virtio5: [vdb] 11824376 512-byte logical blocks (6.05 GB/5.64 GiB)476vm-test-run-nixbot-gitlab> gitlab # [    0.379052] megasas: 07.734.00.00-rc1477vm-test-run-nixbot-gitlab> gitlab # [    0.379820] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]478vm-test-run-nixbot-gitlab> gitlab # [    0.382150] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000479vm-test-run-nixbot-gitlab> gitlab # [    0.382168] Intel/Sharp Extended Query Table at 0x0031480vm-test-run-nixbot-gitlab> gitlab # [    0.383968] Using buffer write method481vm-test-run-nixbot-gitlab> gitlab # [    0.384000] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]482vm-test-run-nixbot-gitlab> gitlab # [    0.386013] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000483vm-test-run-nixbot-gitlab> gitlab # [    0.386049] Intel/Sharp Extended Query Table at 0x0031484vm-test-run-nixbot-gitlab> gitlab # [    0.387976] Using buffer write method485vm-test-run-nixbot-gitlab> gitlab # [    0.387992] Concatenating MTD devices:486vm-test-run-nixbot-gitlab> gitlab # [    0.387994] (0): "0.flash"487vm-test-run-nixbot-gitlab> gitlab # [    0.387997] (1): "0.flash"488vm-test-run-nixbot-gitlab> gitlab # [    0.387999] into device "0.flash"489vm-test-run-nixbot-gitlab> gitlab # [    0.531387] Freeing initrd memory: 25372K490vm-test-run-nixbot-gitlab> gitlab # [    0.549346] tun: Universal TUN/TAP device driver, 1.6491vm-test-run-nixbot-gitlab> gitlab # [    0.557467] thunder_xcv, ver 1.0492vm-test-run-nixbot-gitlab> gitlab # [    0.557575] thunder_bgx, ver 1.0493vm-test-run-nixbot-gitlab> gitlab # [    0.557636] nicpf, ver 1.0494vm-test-run-nixbot-gitlab> gitlab # [    0.559453] e1000: Intel(R) PRO/1000 Network Driver495vm-test-run-nixbot-gitlab> gitlab # [    0.559468] e1000: Copyright (c) 1999-2006 Intel Corporation.496vm-test-run-nixbot-gitlab> gitlab # [    0.559576] e1000e: Intel(R) PRO/1000 Network Driver497vm-test-run-nixbot-gitlab> gitlab # [    0.559590] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.498vm-test-run-nixbot-gitlab> gitlab # [    0.559662] igb: Intel(R) Gigabit Ethernet Network Driver499vm-test-run-nixbot-gitlab> gitlab # [    0.559672] igb: Copyright (c) 2007-2014 Intel Corporation.500vm-test-run-nixbot-gitlab> gitlab # [    0.559735] igbvf: Intel(R) Gigabit Virtual Function Network Driver501vm-test-run-nixbot-gitlab> gitlab # [    0.559745] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.502vm-test-run-nixbot-gitlab> gitlab # [    0.560159] sky2: driver version 1.30503vm-test-run-nixbot-gitlab> gitlab # [    0.565035] usbcore: registered new interface driver usb-storage504vm-test-run-nixbot-gitlab> gitlab # [    0.565157] usbcore: registered new interface driver usbserial_generic505vm-test-run-nixbot-gitlab> gitlab # [    0.565193] usbserial: USB Serial support registered for generic506vm-test-run-nixbot-gitlab> gitlab # [    0.565514] ehci-pci 0000:00:0a.0: EHCI Host Controller507vm-test-run-nixbot-gitlab> gitlab # [    0.565589] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1508vm-test-run-nixbot-gitlab> gitlab # [    0.566355] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000509vm-test-run-nixbot-gitlab> gitlab # [    0.567150] hv_vmbus: registering driver hyperv_keyboard510vm-test-run-nixbot-gitlab> gitlab # [    0.569637] rtc-pl031 9010000.pl031: registered as rtc0511vm-test-run-nixbot-gitlab> gitlab # [    0.569696] rtc-pl031 9010000.pl031: setting system clock to 2026-06-17T14:52:15 UTC (1781707935)512vm-test-run-nixbot-gitlab> gitlab # [    0.570614] i2c_dev: i2c /dev entries driver513vm-test-run-nixbot-gitlab> gitlab # [    0.577483] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00514vm-test-run-nixbot-gitlab> gitlab # [    0.578101] hub 1-0:1.0: USB hub found515vm-test-run-nixbot-gitlab> gitlab # [    0.578129] hub 1-0:1.0: 6 ports detected516vm-test-run-nixbot-gitlab> gitlab # [    0.578976] sdhci: Secure Digital Host Controller Interface driver517vm-test-run-nixbot-gitlab> gitlab # [    0.578989] sdhci: Copyright(c) Pierre Ossman518vm-test-run-nixbot-gitlab> gitlab # [    0.579789] Synopsys Designware Multimedia Card Interface Driver519vm-test-run-nixbot-gitlab> gitlab # [    0.580929] sdhci-pltfm: SDHCI platform and OF driver helper520vm-test-run-nixbot-gitlab> gitlab # [    0.585743] hid: raw HID events driver (C) Jiri Kosina521vm-test-run-nixbot-gitlab> gitlab # [    0.586631] usbcore: registered new interface driver usbhid522vm-test-run-nixbot-gitlab> gitlab # [    0.586642] usbhid: USB HID core driver523vm-test-run-nixbot-gitlab> gitlab # [    0.775113] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available524vm-test-run-nixbot-gitlab> gitlab # [    0.779801] drop_monitor: Initializing network drop monitor service525vm-test-run-nixbot-gitlab> gitlab # [    0.780210] NET: Registered PF_INET6 protocol family526vm-test-run-nixbot-gitlab> gitlab # [    0.782971] Segment Routing with IPv6527vm-test-run-nixbot-gitlab> gitlab # [    0.783053] In-situ OAM (IOAM) with IPv6528vm-test-run-nixbot-gitlab> gitlab # [    0.783150] NET: Registered PF_PACKET protocol family529vm-test-run-nixbot-gitlab> gitlab # [    0.783462] 9pnet: Installing 9P2000 support530vm-test-run-nixbot-gitlab> gitlab # [    0.787542] Key type dns_resolver registered531vm-test-run-nixbot-gitlab> gitlab # [    0.805736] registered taskstats version 1532vm-test-run-nixbot-gitlab> gitlab # [    0.806350] Loading compiled-in X.509 certificates533vm-test-run-nixbot-gitlab> gitlab # [    0.831728] Demotion targets for Node 0: null534vm-test-run-nixbot-gitlab> gitlab # [    0.831922] Key type .fscrypt registered535vm-test-run-nixbot-gitlab> gitlab # [    0.831929] Key type fscrypt-provisioning registered536vm-test-run-nixbot-gitlab> gitlab # [    0.832150] ima: No TPM chip found, activating TPM-bypass!537vm-test-run-nixbot-gitlab> gitlab # [    0.832175] ima: Allocated hash algorithm: sha1538vm-test-run-nixbot-gitlab> gitlab # [    0.832206] ima: No architecture policies found539vm-test-run-nixbot-gitlab> gitlab # [    0.833488] input: gpio-keys as /devices/platform/gpio-keys/input/input0540vm-test-run-nixbot-gitlab> gitlab # [    0.863179] clk: Disabling unused clocks541vm-test-run-nixbot-gitlab> gitlab # [    0.863221] PM: genpd: Disabling unused power domains542vm-test-run-nixbot-gitlab> gitlab # [    0.869329] Freeing unused kernel memory: 4736K543vm-test-run-nixbot-gitlab> gitlab # [    0.869596] Run /init as init process544vm-test-run-nixbot-gitlab> gitlab # [    0.904662] systemd[1]: Successfully made /usr/ read-only.545vm-test-run-nixbot-gitlab> gitlab # [    0.997452] usb 1-1: new high-speed USB device number 2 using ehci-pci546vm-test-run-nixbot-gitlab> gitlab # [    1.158632] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1547vm-test-run-nixbot-gitlab> gitlab # [    1.239598] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)548vm-test-run-nixbot-gitlab> gitlab # [    1.239670] systemd[1]: Detected virtualization qemu.549vm-test-run-nixbot-gitlab> gitlab # [    1.239746] systemd[1]: Detected architecture arm64.550vm-test-run-nixbot-gitlab> gitlab # [    1.239761] systemd[1]: Running in initrd.551vm-test-run-nixbot-gitlab> gitlab # [    1.240779] systemd[1]: Initializing machine ID from random generator.552vm-test-run-nixbot-gitlab> gitlab # [    1.241025] systemd[1]: Hostname set to <gitlab>.553vm-test-run-nixbot-gitlab> gitlab # [    1.262111] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0554vm-test-run-nixbot-gitlab> gitlab # [    1.381449] usb 1-2: new high-speed USB device number 3 using ehci-pci555vm-test-run-nixbot-gitlab> gitlab # [    1.386487] systemd[1]: Queued start job for default target Initrd Default Target.556vm-test-run-nixbot-gitlab> gitlab # [    1.533957] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2557vm-test-run-nixbot-gitlab> gitlab # [    1.534519] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0558vm-test-run-nixbot-gitlab> gitlab # [    1.638678] systemd[1]: Created slice Slice /system/modprobe.559vm-test-run-nixbot-gitlab> gitlab # [    1.639163] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.560vm-test-run-nixbot-gitlab> gitlab # [    1.639233] systemd[1]: Expecting device /dev/disk/by-label/nix-store...561vm-test-run-nixbot-gitlab> gitlab # [    1.639261] systemd[1]: Expecting device /dev/disk/by-label/nixos...562vm-test-run-nixbot-gitlab> gitlab # [    1.639312] systemd[1]: Reached target Path Units.563vm-test-run-nixbot-gitlab> gitlab # [    1.639347] systemd[1]: Reached target Slice Units.564vm-test-run-nixbot-gitlab> gitlab # [    1.639387] systemd[1]: Reached target Swaps.565vm-test-run-nixbot-gitlab> gitlab # [    1.639424] systemd[1]: Reached target Timer Units.566vm-test-run-nixbot-gitlab> gitlab # [    1.639741] systemd[1]: Listening on D-Bus System Message Bus Socket.567vm-test-run-nixbot-gitlab> gitlab # [    1.640059] systemd[1]: Listening on Journal Socket (/dev/log).568vm-test-run-nixbot-gitlab> gitlab # [    1.640368] systemd[1]: Listening on Journal Sockets.569vm-test-run-nixbot-gitlab> gitlab # [    1.640661] systemd[1]: Listening on udev Control Socket.570vm-test-run-nixbot-gitlab> gitlab # [    1.640830] systemd[1]: Listening on udev Kernel Socket.571vm-test-run-nixbot-gitlab> gitlab # [    1.640869] systemd[1]: Reached target Socket Units.572vm-test-run-nixbot-gitlab> gitlab # [    1.647985] systemd[1]: Starting Create List of Static Device Nodes...573vm-test-run-nixbot-gitlab> gitlab # [    1.655665] systemd[1]: Starting Load Kernel Module 9pnet_virtio...574vm-test-run-nixbot-gitlab> gitlab # [    1.655802] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs575vm-test-run-nixbot-gitlab> gitlab # [    1.663201] systemd[1]: Mounting Kernel Configuration File System...576vm-test-run-nixbot-gitlab> gitlab # [    1.684700] systemd[1]: Starting Journal Service...577vm-test-run-nixbot-gitlab> gitlab # [    1.692958] systemd[1]: Starting Load Kernel Modules...578vm-test-run-nixbot-gitlab> gitlab # [    1.693107] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki579vm-test-run-nixbot-gitlab> gitlab # [    1.700190] systemd[1]: Starting Coldplug All udev Devices...580vm-test-run-nixbot-gitlab> gitlab # [    1.715642] systemd[1]: Finished Create List of Static Device Nodes.581vm-test-run-nixbot-gitlab> gitlab # [    1.717461] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.582vm-test-run-nixbot-gitlab> gitlab # [    1.721160] systemd[1]: Finished Load Kernel Module 9pnet_virtio.583vm-test-run-nixbot-gitlab> gitlab # [    1.732847] systemd[1]: Mounted Kernel Configuration File System.584vm-test-run-nixbot-gitlab> gitlab # [    1.738494] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...585vm-test-run-nixbot-gitlab> gitlab # [    1.738541] systemd-journald[154]: Collecting audit messages is disabled.586vm-test-run-nixbot-gitlab> gitlab # [    1.744450] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.587vm-test-run-nixbot-gitlab> gitlab # [    1.751607] [drm] pci: virtio-gpu-pci detected at 0000:00:09.0588vm-test-run-nixbot-gitlab> gitlab # [    1.752014] [drm] features: -virgl +edid -resource_blob -host_visible589vm-test-run-nixbot-gitlab> gitlab # [    1.752032] [drm] features: -context_init590vm-test-run-nixbot-gitlab> gitlab # [    1.753240] [drm] number of scanouts: 1591vm-test-run-nixbot-gitlab> gitlab # [    1.753274] [drm] number of cap sets: 0592vm-test-run-nixbot-gitlab> gitlab # [    1.754184] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev593vm-test-run-nixbot-gitlab> gitlab # [    1.760692] virtio-pci 0000:00:09.0: [drm] Registered 1 planes with drm panic594vm-test-run-nixbot-gitlab> gitlab # [    1.760714] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:09.0 on minor 0595vm-test-run-nixbot-gitlab> gitlab # [    1.777077] Console: switching to colour frame buffer device 160x50596vm-test-run-nixbot-gitlab> gitlab # [    1.778714] virtio-pci 0000:00:09.0: [drm] fb0: virtio_gpudrmfb frame buffer device597vm-test-run-nixbot-gitlab> gitlab # [    1.795160] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.598vm-test-run-nixbot-gitlab> gitlab # [    1.805569] systemd[1]: Starting Create Static Device Nodes in /dev...599vm-test-run-nixbot-gitlab> gitlab # [    1.812038] systemd[1]: Finished Load Kernel Modules.600vm-test-run-nixbot-gitlab> gitlab # [    1.824698] systemd-modules-load[156]: Using 4 probe threads601vm-test-run-nixbot-gitlab> gitlab # [    1.825970] systemd-modules-load[156]: Module 'virtio_balloon' is built in602vm-test-run-nixbot-gitlab> gitlab # [    1.827133] systemd-modules-load[156]: Module 'virtio_console' is built in603vm-test-run-nixbot-gitlab> gitlab # [    1.828328] systemd-modules-load[156]: Module 'virtio_rng' is built in604vm-test-run-nixbot-gitlab> gitlab # [    1.829448] systemd-modules-load[156]: Inserted module 'dm_mod'[    1.831418] systemd[1]: Starting Apply Kernel Variables...605vm-test-run-nixbot-gitlab> gitlab # 606vm-test-run-nixbot-gitlab> gitlab # [    1.832335] systemd[1]: Started Journal Service.607vm-test-run-nixbot-gitlab> gitlab # [    1.834995] systemd-modules-load[156]: Inserted module 'virtio_gpu'608vm-test-run-nixbot-gitlab> gitlab # [    1.848486] systemd[1]: Finished Create Static Device Nodes in /dev.609vm-test-run-nixbot-gitlab> gitlab # [    1.850828] systemd[1]: Reached target Preparation for Local File Systems.610vm-test-run-nixbot-gitlab> gitlab # [    1.853304] systemd[1]: Reached target Local File Systems.611vm-test-run-nixbot-gitlab> gitlab # [    1.855239] systemd[1]: Starting Create System Files and Directories...612vm-test-run-nixbot-gitlab> gitlab # [    1.860263] systemd[1]: Starting Rule-based Manager for Device Events and Files...613vm-test-run-nixbot-gitlab> gitlab # [    1.865258] systemd[1]: Finished Apply Kernel Variables.614vm-test-run-nixbot-gitlab> gitlab # [    1.874796] systemd[1]: Finished Create System Files and Directories.615vm-test-run-nixbot-gitlab> gitlab # [    1.908992] systemd-udevd[189]: Using default interface naming scheme 'v260'.616vm-test-run-nixbot-gitlab> gitlab # [    1.931037] systemd[1]: Started Rule-based Manager for Device Events and Files.617vm-test-run-nixbot-gitlab> gitlab # [    1.967017] systemd[1]: Starting Virtual Console Setup...618vm-test-run-nixbot-gitlab> gitlab # [    2.021779] systemd-vconsole-setup[208]: Configuration of first virtual console was skipped, ignoring remaining ones.619vm-test-run-nixbot-gitlab> gitlab # [    2.030912] systemd[1]: Finished Virtual Console Setup.620vm-test-run-nixbot-gitlab> gitlab # [    2.434490] systemd[1]: Finished Coldplug All udev Devices.621vm-test-run-nixbot-gitlab> gitlab # [    2.436964] systemd[1]: Reached target System Initialization.622vm-test-run-nixbot-gitlab> gitlab # [    2.439289] systemd[1]: Reached target Basic System.623vm-test-run-nixbot-gitlab> gitlab # [    2.647951] (udev-worker)[221]: Network interface NamePolicy= disabled on kernel command line.624vm-test-run-nixbot-gitlab> gitlab # [    2.657930] (udev-worker)[227]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.625vm-test-run-nixbot-gitlab> gitlab # [    2.663122] (udev-worker)[227]: Network interface NamePolicy= disabled on kernel command line.626vm-test-run-nixbot-gitlab> gitlab # [    2.666968] systemd[1]: Found device /dev/disk/by-label/nix-store.627vm-test-run-nixbot-gitlab> gitlab # [    2.673310] systemd[1]: Found device /dev/disk/by-label/nixos.628vm-test-run-nixbot-gitlab> gitlab # [    2.692212] systemd[1]: Reached target Initrd Root Device.629vm-test-run-nixbot-gitlab> gitlab # [    2.694921] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...630vm-test-run-nixbot-gitlab> gitlab # [    2.739782] systemd-fsck[233]: nixos: clean, 12/65536 files, 13019/262144 blocks631vm-test-run-nixbot-gitlab> gitlab # [    2.747362] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.632vm-test-run-nixbot-gitlab> gitlab # [    2.751273] systemd[1]: Mounting /sysroot...633vm-test-run-nixbot-gitlab> gitlab # [    2.791789] EXT4-fs (vda): mounted filesystem 2508b259-92d8-4b15-8b68-bcdee2435ec1 r/w with ordered data mode. Quota mode: none.634vm-test-run-nixbot-gitlab> gitlab # [    2.795130] systemd[1]: Mounted /sysroot.635vm-test-run-nixbot-gitlab> gitlab # [    2.795820] systemd[1]: Reached target Initrd Root File System.636vm-test-run-nixbot-gitlab> gitlab # [    2.799850] systemd[1]: Starting Mountpoints Configured in the Real Root...637vm-test-run-nixbot-gitlab> gitlab # [    2.824618] systemd-sysroot-fstab-check[245]: /sysroot should be mounted in the initrd, will request daemon-reload.638vm-test-run-nixbot-gitlab> gitlab # [    2.828652] systemd[1]: Reload requested from client PID 245 ('systemd-sysroot') (unit initrd-parse-etc.service)...639vm-test-run-nixbot-gitlab> gitlab # [    2.830441] systemd[1]: Reloading...640vm-test-run-nixbot-gitlab> gitlab # [    3.125981] systemd[1]: Reloading finished in 294 ms.641vm-test-run-nixbot-gitlab> gitlab # [    3.158216] systemd-sysroot-fstab-check[245]: Requesting initrd-fs.target/start/replace...642vm-test-run-nixbot-gitlab> gitlab # [    3.254612] systemd-sysroot-fstab-check[245]: Requesting swap.target/start/replace...643vm-test-run-nixbot-gitlab> gitlab # [    3.257539] systemd[1]: initrd-parse-etc.service: Deactivated successfully.644vm-test-run-nixbot-gitlab> gitlab # [    3.260333] systemd[1]: Finished Mountpoints Configured in the Real Root.645vm-test-run-nixbot-gitlab> gitlab # [    3.261459] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.646vm-test-run-nixbot-gitlab> gitlab # [    3.266744] (udev-worker)[216]: mtd0ro: Failed to find and pin callout binary "/nix/store/3x4plcsrj2r4mmzis46wrmyka8g4jhi8-systemd-260.1/lib/udev/mtd_probe": No such file or directory647vm-test-run-nixbot-gitlab> gitlab # [    3.269232] (udev-worker)[216]: mtd0ro: /nix/store/3x4plcsrj2r4mmzis46wrmyka8g4jhi8-systemd-260.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory648vm-test-run-nixbot-gitlab> gitlab # [    3.285082] systemd[1]: Starting Load Kernel Module 9pnet_virtio...649vm-test-run-nixbot-gitlab> gitlab # [    3.285979] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.650vm-test-run-nixbot-gitlab> gitlab # [    3.286946] systemd[1]: Stopped Virtual Console Setup.651vm-test-run-nixbot-gitlab> gitlab # [    3.288383] systemd[1]: Stopping Virtual Console Setup...652vm-test-run-nixbot-gitlab> gitlab # [    3.300720] systemd[1]: Starting Virtual Console Setup...653vm-test-run-nixbot-gitlab> gitlab # [    3.306968] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.654vm-test-run-nixbot-gitlab> gitlab # [    3.310381] systemd[1]: Finished Load Kernel Module 9pnet_virtio.655vm-test-run-nixbot-gitlab> gitlab # [    3.321853] systemd-vconsole-setup[451]: Configuration of first virtual console was skipped, ignoring remaining ones.656vm-test-run-nixbot-gitlab> gitlab # [    3.324601] systemd[1]: Finished Virtual Console Setup.657vm-test-run-nixbot-gitlab> gitlab # [    3.719290] systemd[1]: Mounting /sysroot/nix/.ro-store...658vm-test-run-nixbot-gitlab> gitlab # [    3.726824] systemd[1]: Mounting /sysroot/nix/.rw-store...659vm-test-run-nixbot-gitlab> gitlab # [    3.745766] systemd[1]: Mounting /sysroot/run...660vm-test-run-nixbot-gitlab> gitlab # [    3.755060] systemd[1]: Mounting /sysroot/tmp/shared...661vm-test-run-nixbot-gitlab> gitlab # [    3.765669] systemd[1]: Mounting /sysroot/tmp/xchg...662vm-test-run-nixbot-gitlab> gitlab # [    3.778590] erofs (device vdb): mounted with root inode @ nid 128.663vm-test-run-nixbot-gitlab> gitlab # [    3.797859] systemd[1]: Mounted /sysroot/nix/.ro-store.664vm-test-run-nixbot-gitlab> gitlab # [    3.800347] systemd[1]: Mounted /sysroot/nix/.rw-store.665vm-test-run-nixbot-gitlab> gitlab # [    3.802766] systemd[1]: Mounted /sysroot/run.666vm-test-run-nixbot-gitlab> gitlab # [    3.804871] systemd[1]: Mounted /sysroot/tmp/shared.667vm-test-run-nixbot-gitlab> gitlab # [    3.810639] systemd[1]: Mounted /sysroot/tmp/xchg.668vm-test-run-nixbot-gitlab> gitlab # [    3.822673] systemd[1]: Starting rw-sysroot-nix-store.service...669vm-test-run-nixbot-gitlab> gitlab # [    3.868354] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.670vm-test-run-nixbot-gitlab> gitlab # [    3.873305] systemd[1]: Finished rw-sysroot-nix-store.service.671vm-test-run-nixbot-gitlab> gitlab # [    4.717308] systemd[1]: Mounting /sysroot/nix/store...672vm-test-run-nixbot-gitlab> gitlab # [    4.795906] systemd[1]: Mounted /sysroot/nix/store.673vm-test-run-nixbot-gitlab> gitlab # [    4.798195] systemd[1]: Reached target Initrd File Systems.674vm-test-run-nixbot-gitlab> gitlab # [    4.803832] systemd[1]: Starting Find NixOS closure...675vm-test-run-nixbot-gitlab> gitlab # [    4.811087] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...676vm-test-run-nixbot-gitlab> gitlab # [    4.863819] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.677vm-test-run-nixbot-gitlab> gitlab # [    4.867516] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.678vm-test-run-nixbot-gitlab> gitlab # [    4.890399] systemd[1]: Finished Find NixOS closure.679vm-test-run-nixbot-gitlab> gitlab # [    4.892800] systemd[1]: Reached target Initrd Default Target.680vm-test-run-nixbot-gitlab> gitlab # [    4.899613] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...681vm-test-run-nixbot-gitlab> gitlab # [    4.961369] systemd[1]: Stopped target Initrd Default Target.682vm-test-run-nixbot-gitlab> gitlab # [    4.963769] systemd[1]: Stopped target Basic System.683vm-test-run-nixbot-gitlab> gitlab # [    4.966065] systemd[1]: Stopped target Initrd Root Device.684vm-test-run-nixbot-gitlab> gitlab # [    4.968407] systemd[1]: Stopped target Path Units.685vm-test-run-nixbot-gitlab> gitlab # [    4.970476] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.686vm-test-run-nixbot-gitlab> gitlab # [    4.973623] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.687vm-test-run-nixbot-gitlab> gitlab # [    4.976734] systemd[1]: Stopped target Slice Units.688vm-test-run-nixbot-gitlab> gitlab # [    4.978768] systemd[1]: Stopped target Socket Units.689vm-test-run-nixbot-gitlab> gitlab # [    4.980941] systemd[1]: Stopped target System Initialization.690vm-test-run-nixbot-gitlab> gitlab # [    4.983271] systemd[1]: Stopped target Swaps.691vm-test-run-nixbot-gitlab> gitlab # [    4.985282] systemd[1]: Stopped target Timer Units.692vm-test-run-nixbot-gitlab> gitlab # [    4.987325] systemd[1]: dbus.socket: Deactivated successfully.693vm-test-run-nixbot-gitlab> gitlab # [    4.989824] systemd[1]: Closed D-Bus System Message Bus Socket.694vm-test-run-nixbot-gitlab> gitlab # [    4.992250] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.695vm-test-run-nixbot-gitlab> gitlab # [    4.995261] systemd[1]: Stopped Find NixOS closure.696vm-test-run-nixbot-gitlab> gitlab # [    4.997451] systemd[1]: Starting Load Kernel Module 9pnet_virtio...697vm-test-run-nixbot-gitlab> gitlab # [    4.999966] systemd[1]: Starting rw-sysroot-nix-store.service...698vm-test-run-nixbot-gitlab> gitlab # [    5.002395] systemd[1]: systemd-sysctl.service: Deactivated successfully.699vm-test-run-nixbot-gitlab> gitlab # [    5.004873] systemd[1]: Stopped Apply Kernel Variables.700vm-test-run-nixbot-gitlab> gitlab # [    5.008504] systemd[1]: systemd-modules-load.service: Deactivated successfully.701vm-test-run-nixbot-gitlab> gitlab # [    5.010993] systemd[1]: Stopped Load Kernel Modules.702vm-test-run-nixbot-gitlab> gitlab # [    5.018230] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.703vm-test-run-nixbot-gitlab> gitlab # [    5.021750] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.704vm-test-run-nixbot-gitlab> gitlab # [    5.025930] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.705vm-test-run-nixbot-gitlab> gitlab # [    5.029058] systemd[1]: Stopped Create System Files and Directories.706vm-test-run-nixbot-gitlab> gitlab # [    5.035003] systemd[1]: Stopped target Local File Systems.707vm-test-run-nixbot-gitlab> gitlab # [    5.037541] systemd[1]: Stopped target Preparation for Local File Systems.708vm-test-run-nixbot-gitlab> gitlab # [    5.040301] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.709vm-test-run-nixbot-gitlab> gitlab # [    5.043200] systemd[1]: Stopped Coldplug All udev Devices.710vm-test-run-nixbot-gitlab> gitlab # [    5.046573] systemd[1]: Stopping Rule-based Manager for Device Events and Files...711vm-test-run-nixbot-gitlab> gitlab # [    5.049675] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.712vm-test-run-nixbot-gitlab> gitlab # [    5.052540] systemd[1]: Stopped Virtual Console Setup.713vm-test-run-nixbot-gitlab> gitlab # [    5.064127] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.714vm-test-run-nixbot-gitlab> gitlab # [    5.069313] systemd[1]: Finished Load Kernel Module 9pnet_virtio.715vm-test-run-nixbot-gitlab> gitlab # [    5.080505] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.716vm-test-run-nixbot-gitlab> gitlab # [    5.086103] systemd[1]: Finished rw-sysroot-nix-store.service.717vm-test-run-nixbot-gitlab> gitlab # [    5.096076] systemd[1]: systemd-udevd.service: Deactivated successfully.718vm-test-run-nixbot-gitlab> gitlab # [    5.101269] systemd[1]: Stopped Rule-based Manager for Device Events and Files.719vm-test-run-nixbot-gitlab> gitlab # [    5.104201] systemd[1]: systemd-udevd.service: Consumed 2.350s CPU time over 3.236s wall clock time, 32.4M memory peak.720vm-test-run-nixbot-gitlab> gitlab # [    5.121560] systemd[1]: initrd-cleanup.service: Deactivated successfully.721vm-test-run-nixbot-gitlab> gitlab # [    5.126220] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.722vm-test-run-nixbot-gitlab> gitlab # [    5.140136] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.723vm-test-run-nixbot-gitlab> gitlab # [    5.143043] systemd[1]: Closed udev Control Socket.724vm-test-run-nixbot-gitlab> gitlab # [    5.155841] systemd[1]: Starting Cleanup udev Database...725vm-test-run-nixbot-gitlab> gitlab # [    5.158323] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.726vm-test-run-nixbot-gitlab> gitlab # [    5.161512] systemd[1]: Stopped Create Static Device Nodes in /dev.727vm-test-run-nixbot-gitlab> gitlab # [    5.164484] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.728vm-test-run-nixbot-gitlab> gitlab # [    5.167724] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.729vm-test-run-nixbot-gitlab> gitlab # [    5.173031] systemd[1]: kmod-static-nodes.service: Deactivated successfully.730vm-test-run-nixbot-gitlab> gitlab # [    5.175804] systemd[1]: Stopped Create List of Static Device Nodes.731vm-test-run-nixbot-gitlab> gitlab # [    5.255753] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.732vm-test-run-nixbot-gitlab> gitlab # [    5.260581] systemd[1]: Finished Cleanup udev Database.733vm-test-run-nixbot-gitlab> gitlab # [    5.270328] systemd[1]: Reached target Switch Root.734vm-test-run-nixbot-gitlab> gitlab # [    5.277373] systemd[1]: Starting NixOS Activation...735vm-test-run-nixbot-gitlab> gitlab # [    5.468445] initrd-nixos-activation-start[562]: booting system configuration /nix/store/y4gn0sc342na7svj38rb3db5nim07hwx-nixos-system-gitlab-test736vm-test-run-nixbot-gitlab> gitlab # [    5.532671] initrd-nixos-activation-start[562]: running activation script...737vm-test-run-nixbot-gitlab> gitlab # [    5.921940] initrd-nixos-activation-start[585]: setting up /etc...738vm-test-run-nixbot-gitlab> gitlab # [    6.107350] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.739vm-test-run-nixbot-gitlab> gitlab # [    6.111237] systemd[1]: Finished NixOS Activation.740vm-test-run-nixbot-gitlab> gitlab # [    6.127972] systemd[1]: Starting Switch Root...741vm-test-run-nixbot-gitlab> gitlab # [    6.176659] systemd[1]: Switching root.742vm-test-run-nixbot-gitlab> gitlab # [    6.758282] systemd-journald[154]: Received SIGTERM from PID 1 (systemd).743vm-test-run-nixbot-gitlab> gitlab # [    7.482935] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)744vm-test-run-nixbot-gitlab> gitlab # [    7.483076] systemd[1]: Detected virtualization qemu.745vm-test-run-nixbot-gitlab> gitlab # [    7.483165] systemd[1]: Detected architecture arm64.746vm-test-run-nixbot-gitlab> gitlab # [    7.483337] systemd[1]: Detected first boot.747vm-test-run-nixbot-gitlab> gitlab # [    7.484828] systemd[1]: Initializing machine ID from random generator.748vm-test-run-nixbot-gitlab> gitlab # [    7.730773] systemd[1]: bpf-restrict-fs: LSM BPF program attached749vm-test-run-nixbot-gitlab> gitlab # [    7.830517] systemd[1]: Applying preset policy.750vm-test-run-nixbot-gitlab> gitlab # [    8.066622] systemd[1]: Populated /etc with preset unit settings.751vm-test-run-nixbot-gitlab> gitlab # [    8.237608] systemd[1]: initrd-switch-root.service: Deactivated successfully.752vm-test-run-nixbot-gitlab> gitlab # [    8.238322] systemd[1]: Stopped initrd-switch-root.service.753vm-test-run-nixbot-gitlab> gitlab # [    8.241923] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.754vm-test-run-nixbot-gitlab> gitlab # [    8.247757] systemd[1]: Created slice Slice /system/getty.755vm-test-run-nixbot-gitlab> gitlab # [    8.251399] systemd[1]: Created slice GitLab DevOps Platform Slice.756vm-test-run-nixbot-gitlab> gitlab # [    8.256124] systemd[1]: Created slice User and Session Slice.757vm-test-run-nixbot-gitlab> gitlab # [    8.257597] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.758vm-test-run-nixbot-gitlab> gitlab # [    8.258926] systemd[1]: Started Forward Password Requests to Wall Directory Watch.759vm-test-run-nixbot-gitlab> gitlab # [    8.260073] systemd[1]: Expecting device /dev/hvc0...760vm-test-run-nixbot-gitlab> gitlab # [    8.261243] systemd[1]: Expecting device /dev/ttyAMA0...761vm-test-run-nixbot-gitlab> gitlab # [    8.262424] systemd[1]: Reached target Local Encrypted Volumes.762vm-test-run-nixbot-gitlab> gitlab # [    8.263510] systemd[1]: Stopped target initrd-fs.target.763vm-test-run-nixbot-gitlab> gitlab # [    8.264572] systemd[1]: Stopped target initrd-root-fs.target.764vm-test-run-nixbot-gitlab> gitlab # [    8.265686] systemd[1]: Stopped target initrd-switch-root.target.765vm-test-run-nixbot-gitlab> gitlab # [    8.266804] systemd[1]: Reached target Virtual Machines and Containers.766vm-test-run-nixbot-gitlab> gitlab # [    8.267953] systemd[1]: Reached target Path Units.767vm-test-run-nixbot-gitlab> gitlab # [    8.269034] systemd[1]: Reached target Remote File Systems.768vm-test-run-nixbot-gitlab> gitlab # [    8.270146] systemd[1]: Reached target Slice Units.769vm-test-run-nixbot-gitlab> gitlab # [    8.271194] systemd[1]: Reached target Swaps.770vm-test-run-nixbot-gitlab> gitlab # [    8.275651] systemd[1]: Listening on Process Core Dump Socket.771vm-test-run-nixbot-gitlab> gitlab # [    8.278883] systemd[1]: Listening on Credential Encryption/Decryption.772vm-test-run-nixbot-gitlab> gitlab # [    8.289130] systemd[1]: Starting Journal Log Access Socket...773vm-test-run-nixbot-gitlab> gitlab # [    8.291150] systemd[1]: Listening on Journal Audit Socket.774vm-test-run-nixbot-gitlab> gitlab # [    8.292545] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.775vm-test-run-nixbot-gitlab> gitlab # [    8.293521] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki776vm-test-run-nixbot-gitlab> gitlab # [    8.294689] systemd[1]: Listening on udev Control Socket.777vm-test-run-nixbot-gitlab> gitlab # [    8.311581] systemd[1]: Mounting Huge Pages File System...778vm-test-run-nixbot-gitlab> gitlab # [    8.319922] systemd[1]: Mounting POSIX Message Queue File System...779vm-test-run-nixbot-gitlab> gitlab # [    8.325293] systemd[1]: Mounting Kernel Debug File System...780vm-test-run-nixbot-gitlab> gitlab # [    8.334251] systemd[1]: Mounting Kernel Trace File System...781vm-test-run-nixbot-gitlab> gitlab # [    8.341119] systemd[1]: Starting Create List of Static Device Nodes...782vm-test-run-nixbot-gitlab> gitlab # [    8.353888] systemd[1]: Starting Load Kernel Module 9pnet_virtio...783vm-test-run-nixbot-gitlab> gitlab # [    8.357227] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs784vm-test-run-nixbot-gitlab> gitlab # [    8.366290] systemd[1]: Mounting Kernel Configuration File System...785vm-test-run-nixbot-gitlab> gitlab # [    8.369656] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm786vm-test-run-nixbot-gitlab> gitlab # [    8.373743] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore787vm-test-run-nixbot-gitlab> gitlab # [    8.382557] systemd[1]: Starting Load Kernel Module fuse...788vm-test-run-nixbot-gitlab> gitlab # [    8.383853] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67789vm-test-run-nixbot-gitlab> gitlab # [    8.394520] systemd[1]: Starting Journal Service...790vm-test-run-nixbot-gitlab> gitlab # [    8.400856] systemd[1]: Starting Load Kernel Modules...791vm-test-run-nixbot-gitlab> gitlab # [    8.413695] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...792vm-test-run-nixbot-gitlab> gitlab # [    8.418268] fuse: init (API version 7.45)793vm-test-run-nixbot-gitlab> gitlab # [    8.425580] systemd[1]: Starting Remount Root and Kernel File Systems...794vm-test-run-nixbot-gitlab> gitlab # [    8.426288] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki795vm-test-run-nixbot-gitlab> gitlab # [    8.440781] systemd[1]: Starting Coldplug All udev Devices...796vm-test-run-nixbot-gitlab> gitlab # [    8.445777] systemd[1]: Listening on Journal Log Access Socket.797vm-test-run-nixbot-gitlab> gitlab # [    8.446572] systemd[1]: Mounted Huge Pages File System.798vm-test-run-nixbot-gitlab> gitlab # [    8.447427] systemd[1]: Mounted POSIX Message Queue File System.799vm-test-run-nixbot-gitlab> gitlab # [    8.448204] systemd[1]: Mounted Kernel Debug File System.800vm-test-run-nixbot-gitlab> gitlab # [    8.448953] systemd[1]: Mounted Kernel Trace File System.801vm-test-run-nixbot-gitlab> gitlab # [    8.450061] systemd[1]: Finished Create List of Static Device Nodes.802vm-test-run-nixbot-gitlab> gitlab # [    8.451107] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.803vm-test-run-nixbot-gitlab> gitlab # [    8.452057] systemd[1]: Finished Load Kernel Module 9pnet_virtio.804vm-test-run-nixbot-gitlab> gitlab # [    8.452907] systemd[1]: Mounted Kernel Configuration File System.805vm-test-run-nixbot-gitlab> gitlab # [    8.453858] systemd[1]: modprobe@fuse.service: Deactivated successfully.806vm-test-run-nixbot-gitlab> gitlab # [    8.454806] systemd[1]: Finished Load Kernel Module fuse.807vm-test-run-nixbot-gitlab> gitlab # [    8.468897] systemd-journald[794]: Collecting audit messages is enabled.808vm-test-run-nixbot-gitlab> gitlab # [    8.468992] systemd[1]: Mounting FUSE Control File System...809vm-test-run-nixbot-gitlab> gitlab # [    8.478714] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...810vm-test-run-nixbot-gitlab> gitlab # [    8.482640] systemd[1]: Finished Load Kernel Modules.811vm-test-run-nixbot-gitlab> gitlab # [    8.495147] systemd[1]: Starting Firewall...812vm-test-run-nixbot-gitlab> gitlab # [    8.496150] systemd[1]: Queued start job for default target Multi-User System.813vm-test-run-nixbot-gitlab> gitlab # [    8.497553] systemd[1]: Unnecessary job was removed for /dev/vdb.814vm-test-run-nixbot-gitlab> gitlab # [    8.498679] systemd[1]: systemd-journald.service: Deactivated successfully.815vm-test-run-nixbot-gitlab> gitlab # [    8.499987] systemd-modules-load[795]: Using 3 probe threads816vm-test-run-nixbot-gitlab> gitlab # [    8.501147] systemd-modules-load[795]: Module 'atkbd' is built in817vm-test-run-nixbot-gitlab> gitlab # [    8.503395] EXT4-fs (vda): re-mounted 2508b259-92d8-4b15-8b68-bcdee2435ec1.818vm-test-run-nixbot-gitlab> gitlab # [    8.503335] systemd-modules-load[795]: Module 'loop' is built in819vm-test-run-nixbot-gitlab> gitlab # [    8.505536] systemd-modules-load[795]: Inserted module 'tls'820vm-test-run-nixbot-gitlab> gitlab # [    8.509249] systemd[1]: Starting Apply Kernel Variables...821vm-test-run-nixbot-gitlab> gitlab # [    8.513845] systemd[1]: Started Journal Service.822vm-test-run-nixbot-gitlab> gitlab # [    8.520148] systemd[1]: Finished Remount Root and Kernel File Systems.823vm-test-run-nixbot-gitlab> gitlab # [    8.521823] systemd[1]: Mounted FUSE Control File System.824vm-test-run-nixbot-gitlab> gitlab # [    8.535744] systemd-oomd[796]: No swap; memory pressure usage will be degraded825vm-test-run-nixbot-gitlab> gitlab # [    8.539643] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.826vm-test-run-nixbot-gitlab> gitlab # [    8.541793] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.827vm-test-run-nixbot-gitlab> gitlab # [    8.547781] systemd[1]: Finished Apply Kernel Variables.828vm-test-run-nixbot-gitlab> gitlab # [    8.552522] systemd[1]: Starting Flush Journal to Persistent Storage...829vm-test-run-nixbot-gitlab> gitlab # [    8.556227] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore830vm-test-run-nixbot-gitlab> gitlab # [    8.558063] systemd[1]: Starting Load/Save OS Random Seed...831vm-test-run-nixbot-gitlab> gitlab # [    8.563385] systemd[1]: Starting Create Static Device Nodes in /dev...832vm-test-run-nixbot-gitlab> gitlab # [    8.565078] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki833vm-test-run-nixbot-gitlab> gitlab # [    8.600690] systemd-journald[794]: Received client request to flush runtime journal.834vm-test-run-nixbot-gitlab> gitlab # [    8.626823] systemd[1]: Finished Create Static Device Nodes in /dev.835vm-test-run-nixbot-gitlab> gitlab # [    8.629530] systemd[1]: Reached target Preparation for Local File Systems.836vm-test-run-nixbot-gitlab> gitlab # [    8.630629] systemd[1]: Starting Rule-based Manager for Device Events and Files...837vm-test-run-nixbot-gitlab> gitlab # [    8.631745] systemd[1]: Finished Load/Save OS Random Seed.838vm-test-run-nixbot-gitlab> gitlab # [    8.632737] systemd[1]: Reached target First Boot Complete.839vm-test-run-nixbot-gitlab> gitlab # [    8.633576] systemd[1]: Finished Flush Journal to Persistent Storage.840vm-test-run-nixbot-gitlab> gitlab # [    8.663746] systemd-udevd[844]: Using default interface naming scheme 'v260'.841vm-test-run-nixbot-gitlab> gitlab # [    8.706369] systemd[1]: Started Rule-based Manager for Device Events and Files.842vm-test-run-nixbot-gitlab> gitlab # [    8.913317] systemd[1]: Finished Firewall.843vm-test-run-nixbot-gitlab> gitlab # [    9.207869] systemd[1]: Finished Coldplug All udev Devices.844vm-test-run-nixbot-gitlab> gitlab # [    9.240361] systemd[1]: Mounting /run/wrappers...845vm-test-run-nixbot-gitlab> gitlab # [    9.265991] systemd[1]: Mounted /run/wrappers.846vm-test-run-nixbot-gitlab> gitlab # [    9.267996] systemd[1]: Reached target Local File Systems.847vm-test-run-nixbot-gitlab> gitlab # [    9.270307] systemd[1]: Listening on Boot Loader Control Service Socket.848vm-test-run-nixbot-gitlab> gitlab # [    9.274639] systemd[1]: Starting register-nix-paths.service...849vm-test-run-nixbot-gitlab> gitlab # [    9.279772] systemd[1]: Starting Create SUID/SGID Wrappers...850vm-test-run-nixbot-gitlab> gitlab # [    9.284519] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.851vm-test-run-nixbot-gitlab> gitlab # [    9.296625] systemd[1]: Starting Save Transient machine-id to Disk...852vm-test-run-nixbot-gitlab> gitlab # [    9.304837] systemd[1]: Starting Create System Files and Directories...853vm-test-run-nixbot-gitlab> gitlab # [    9.315761] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs854vm-test-run-nixbot-gitlab> gitlab # [    9.357748] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.855vm-test-run-nixbot-gitlab> gitlab # [    9.364157] systemd[1]: Finished Save Transient machine-id to Disk.856vm-test-run-nixbot-gitlab> gitlab # [    9.379830] systemd[1]: Finished Create System Files and Directories.857vm-test-run-nixbot-gitlab> gitlab # [    9.389582] systemd[1]: Starting Rebuild Journal Catalog...858vm-test-run-nixbot-gitlab> gitlab # [    9.392086] systemd[1]: Starting Record System Boot/Shutdown in UTMP...859vm-test-run-nixbot-gitlab> gitlab # [    9.423306] systemd[1]: Finished Record System Boot/Shutdown in UTMP.860vm-test-run-nixbot-gitlab> gitlab # [    9.442890] systemd[1]: Finished Rebuild Journal Catalog.861vm-test-run-nixbot-gitlab> gitlab # [    9.458035] systemd[1]: Starting Update is Completed...862vm-test-run-nixbot-gitlab> gitlab # [    9.459076] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.863vm-test-run-nixbot-gitlab> gitlab # [    9.467669] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.864vm-test-run-nixbot-gitlab> gitlab # [    9.469551] systemd[1]: Finished Update is Completed.865vm-test-run-nixbot-gitlab> gitlab # [    9.495393] (udev-worker)[885]: Network interface NamePolicy= disabled on kernel command line.866vm-test-run-nixbot-gitlab> gitlab # [    9.511900] (udev-worker)[953]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.867vm-test-run-nixbot-gitlab> gitlab # [    9.514479] (udev-worker)[953]: Network interface NamePolicy= disabled on kernel command line.868vm-test-run-nixbot-gitlab> gitlab # [    9.541876] systemd[1]: Condition check resulted in Virtio network device being skipped.869vm-test-run-nixbot-gitlab> gitlab # [    9.544709] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore870vm-test-run-nixbot-gitlab> gitlab # [    9.546166] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.871vm-test-run-nixbot-gitlab> gitlab # [    9.547353] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67872vm-test-run-nixbot-gitlab> gitlab # [    9.550881] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore873vm-test-run-nixbot-gitlab> gitlab # [    9.553166] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki874vm-test-run-nixbot-gitlab> gitlab # [    9.554817] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki875vm-test-run-nixbot-gitlab> gitlab # [    9.556607] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.876vm-test-run-nixbot-gitlab> gitlab # [    9.558826] systemd[1]: Finished Create SUID/SGID Wrappers.877vm-test-run-nixbot-gitlab> gitlab # [    9.559627] systemd[1]: suid-sgid-wrappers.service: Consumed 190ms CPU time over 271ms wall clock time, 6.9M memory peak, 2.2M read from disk.878vm-test-run-nixbot-gitlab> gitlab # [    9.590480] mousedev: PS/2 mouse device common for all mice879vm-test-run-nixbot-gitlab> gitlab # [    9.803125] systemd[1]: Finished register-nix-paths.service.880vm-test-run-nixbot-gitlab> gitlab # [    9.804303] systemd[1]: Reached target System Initialization.881vm-test-run-nixbot-gitlab> gitlab # [    9.805164] systemd[1]: Started Discard unused filesystem blocks once a week.882vm-test-run-nixbot-gitlab> gitlab # [    9.806147] systemd[1]: Started logrotate.timer.883vm-test-run-nixbot-gitlab> gitlab # [    9.806822] systemd[1]: Started Daily Cleanup of Temporary Directories.884vm-test-run-nixbot-gitlab> gitlab # [    9.807721] systemd[1]: Reached target Timer Units.885vm-test-run-nixbot-gitlab> gitlab # [    9.808539] systemd[1]: Listening on D-Bus System Message Bus Socket.886vm-test-run-nixbot-gitlab> gitlab # [    9.809977] systemd[1]: Listening on Nix Daemon Socket.887vm-test-run-nixbot-gitlab> gitlab # [    9.823686] systemd[1]: Starting nixbot CI service socket...888vm-test-run-nixbot-gitlab> gitlab # [    9.824686] systemd[1]: Listening on Hostname Service Socket.889vm-test-run-nixbot-gitlab> gitlab # [    9.827071] systemd[1]: Starting D-Bus System Message Bus...890vm-test-run-nixbot-gitlab> gitlab # [    9.828483] systemd[1]: Listening on nixbot CI service socket.891vm-test-run-nixbot-gitlab> gitlab # [    9.829372] systemd[1]: Reached target Socket Units.892vm-test-run-nixbot-gitlab> gitlab # [    9.861406] dbus-broker-launch[1044]: Looking up NSS user entry for 'systemd-timesync'...893vm-test-run-nixbot-gitlab> gitlab # [    9.864475] dbus-broker-launch[1044]: NSS returned no entry for 'systemd-timesync'894vm-test-run-nixbot-gitlab> gitlab # [    9.865858] dbus-broker-launch[1044]: Invalid user-name in /nix/store/ifm9k575wb3j66gvjx1xkdmmknzqr8v8-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"895vm-test-run-nixbot-gitlab> gitlab # [    9.870858] systemd[1]: Started D-Bus System Message Bus.896vm-test-run-nixbot-gitlab> gitlab # [    9.881323] dbus-broker-launch[1044]: Ready897vm-test-run-nixbot-gitlab> gitlab # [    9.882560] systemd[1]: Reached target Basic System.898vm-test-run-nixbot-gitlab> gitlab # [    9.884099] systemd[1]: Started backdoor.service.899vm-test-run-nixbot-gitlab> gitlab # [    9.888302] systemd[1]: Starting gitlab-config.service...900vm-test-run-nixbot-gitlab> gitlab # [    9.900271] systemd[1]: Starting Import lastlog data into lastlog2 database...901vm-test-run-nixbot-gitlab> gitlab # [    9.904221] systemd[1]: Starting Logrotate configuration check...902vm-test-run-nixbot-gitlab> gitlab # [    9.911706] systemd[1]: Starting Name Service Cache Daemon (nsncd)...903vm-test-run-nixbot-gitlab> gitlab # connecting to host...904vm-test-run-nixbot-gitlab> gitlab # [    9.920095] systemd[1]: Starting Post-Boot Actions...905vm-test-run-nixbot-gitlab> gitlab # [    9.921430] logrotate[1049]: warning: logrotate in debug mode does nothing except printing debug messages!  Consider using verbose mode (-v) instead if this is not what you want.906vm-test-run-nixbot-gitlab> gitlab # [    9.926374] systemd[1]: Started Reset console on configuration changes.907vm-test-run-nixbot-gitlab> gitlab # [    9.927497] logrotate[1049]: reading config file /nix/store/hk6ay5j24mh4h8mpr5rxlxxxp8v61fnj-logrotate.conf908vm-test-run-nixbot-gitlab> gitlab: Guest shell says: b'Spawning backdoor root shell...\n'909vm-test-run-nixbot-gitlab> gitlab: connected to guest root shell910vm-test-run-nixbot-gitlab> gitlab: (connecting took 10.36 seconds)911vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for the VM to finish booting, in 10.36 seconds)912vm-test-run-nixbot-gitlab> gitlab # [    9.931292] logrotate[1049]: note: 'monthly' overrides previously specified 'weekly'913vm-test-run-nixbot-gitlab> gitlab # [    9.932381] logrotate[1049]: Reading state from file: /var/lib/logrotate.status914vm-test-run-nixbot-gitlab> gitlab # [    9.933246] logrotate[1049]: state file /var/lib/logrotate.status does not exist915vm-test-run-nixbot-gitlab> gitlab # [    9.934090] logrotate[1049]: Allocating hash table for state file, size 64 entries916vm-test-run-nixbot-gitlab> gitlab # [    9.934932] logrotate[1049]: Handling 4 logs917vm-test-run-nixbot-gitlab> gitlab # [    9.935500] logrotate[1049]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed918vm-test-run-nixbot-gitlab> gitlab # [    9.940335] logrotate[1049]: considering log /var/log/btmp919vm-test-run-nixbot-gitlab> gitlab # [    9.944135] logrotate[1049]: Creating new state920vm-test-run-nixbot-gitlab> gitlab # [    9.944804] logrotate[1049]:   Now: 2026-06-17 14:52921vm-test-run-nixbot-gitlab> gitlab # [    9.945459] logrotate[1049]:   Last rotated at 2026-06-17 14:00922vm-test-run-nixbot-gitlab> gitlab # [    9.946210] logrotate[1049]:   log does not need rotating (log has already been rotated)923vm-test-run-nixbot-gitlab> gitlab # [    9.947210] logrotate[1049]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed924vm-test-run-nixbot-gitlab> gitlab # [    9.949914] logrotate[1049]: considering log /var/log/wtmp925vm-test-run-nixbot-gitlab> gitlab # [    9.950669] logrotate[1049]: Creating new state926vm-test-run-nixbot-gitlab> gitlab # [    9.951274] logrotate[1049]:   Now: 2026-06-17 14:52927vm-test-run-nixbot-gitlab> gitlab # [    9.952217] logrotate[1049]:   Last rotated at 2026-06-17 14:00928vm-test-run-nixbot-gitlab> gitlab # [    9.952981] logrotate[1049]:   log does not need rotating (log has already been rotated)929vm-test-run-nixbot-gitlab> gitlab # [    9.953968] logrotate[1049]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed930vm-test-run-nixbot-gitlab> gitlab # [    9.957973] logrotate[1049]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1049)931vm-test-run-nixbot-gitlab> gitlab # [    9.959045] logrotate[1049]: considering log /var/gitlab/state/log/*.log932vm-test-run-nixbot-gitlab> gitlab # [    9.959875] logrotate[1049]:   log /var/gitlab/state/log/*.log does not exist -- skipping933vm-test-run-nixbot-gitlab> gitlab # [    9.961044] logrotate[1049]: Creating new state934vm-test-run-nixbot-gitlab> gitlab # [    9.961636] logrotate[1049]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1049)935vm-test-run-nixbot-gitlab> gitlab # [    9.962700] logrotate[1049]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed936vm-test-run-nixbot-gitlab> gitlab # [    9.964826] logrotate[1049]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1049)937vm-test-run-nixbot-gitlab> gitlab # [    9.965857] logrotate[1049]: considering log /var/log/nginx/*.log938vm-test-run-nixbot-gitlab> gitlab # [    9.966630] logrotate[1049]:   log /var/log/nginx/*.log does not exist -- skipping939vm-test-run-nixbot-gitlab> gitlab # [    9.967566] logrotate[1049]: Creating new state940vm-test-run-nixbot-gitlab> gitlab # [    9.968229] logrotate[1049]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1049)941vm-test-run-nixbot-gitlab> gitlab # [    9.969318] systemd[1]: Starting resolvconf update...942vm-test-run-nixbot-gitlab> gitlab # [    9.972113] systemd[1]: Finished Logrotate configuration check.943vm-test-run-nixbot-gitlab> gitlab # [    9.975981] systemd[1]: Finished Post-Boot Actions.944vm-test-run-nixbot-gitlab> gitlab # [    9.977570] systemd[1]: Finished Import lastlog data into lastlog2 database.945vm-test-run-nixbot-gitlab> gitlab # [    9.978753] systemd[1]: Started Name Service Cache Daemon (nsncd).946vm-test-run-nixbot-gitlab> gitlab # [    9.979984] nsncd[1052]: Jun 17 14:52:24.910 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"947vm-test-run-nixbot-gitlab> gitlab # [    9.983055] systemd[1]: Reached target Host and Network Name Lookups.948vm-test-run-nixbot-gitlab> gitlab # [    9.983968] systemd[1]: Reached target User and Group Name Lookups.949vm-test-run-nixbot-gitlab> gitlab # [    9.987124] systemd[1]: Starting User Login Management...950vm-test-run-nixbot-gitlab> gitlab # [   10.171908] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:08.0/virtio7/input/input3951vm-test-run-nixbot-gitlab> gitlab # [   10.058164] systemd-logind[1086]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)952vm-test-run-nixbot-gitlab> gitlab # [   10.274766] systemd-logind[1086]: Watching system buttons on /dev/input/event0 (gpio-keys)953vm-test-run-nixbot-gitlab> gitlab # [   10.295801] systemd[1]: Stopped target Host and Network Name Lookups.954vm-test-run-nixbot-gitlab> gitlab # [   10.300133] systemd[1]: Stopping Host and Network Name Lookups...955vm-test-run-nixbot-gitlab> gitlab # [   10.306080] systemd[1]: Stopped target User and Group Name Lookups.956vm-test-run-nixbot-gitlab> gitlab # [   10.307144] systemd[1]: Stopping User and Group Name Lookups...957vm-test-run-nixbot-gitlab> gitlab # [   10.309086] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...958vm-test-run-nixbot-gitlab> gitlab # [   10.310850] systemd[1]: nscd.service: Deactivated successfully.959vm-test-run-nixbot-gitlab> gitlab # [   10.315514] systemd[1]: Stopped Name Service Cache Daemon (nsncd).960vm-test-run-nixbot-gitlab> gitlab # [   10.316513] systemd[1]: nscd.service: Consumed 25ms CPU time over 161ms wall clock time, 8M memory peak, 5.9M read from disk.961vm-test-run-nixbot-gitlab> gitlab # [   10.317948] systemd-logind[1086]: New seat seat0.962vm-test-run-nixbot-gitlab> gitlab # [   10.318667] systemd[1]: Finished resolvconf update.963vm-test-run-nixbot-gitlab> gitlab # [   10.319323] systemd[1]: Reached target Preparation for Network.964vm-test-run-nixbot-gitlab> gitlab # [   10.323421] systemd[1]: Starting DHCP Client...965vm-test-run-nixbot-gitlab> gitlab # [   10.328293] network-addresses-eth1-start[1151]: adding address 192.168.1.1/24... done966vm-test-run-nixbot-gitlab> gitlab # [   10.330607] systemd[1]: Starting Address configuration of eth1...967vm-test-run-nixbot-gitlab> gitlab # [   10.331459] network-addresses-eth1-start[1151]: adding address 2001:db8:1::1/64... done968vm-test-run-nixbot-gitlab> gitlab # [   10.335702] systemd[1]: Starting Extra networking commands....969vm-test-run-nixbot-gitlab> gitlab # [   10.336951] systemd[1]: Starting Name Service Cache Daemon (nsncd)...970vm-test-run-nixbot-gitlab> gitlab # [   10.338265] systemd[1]: Started User Login Management.971vm-test-run-nixbot-gitlab> gitlab # [   10.351826] nsncd[1153]: Jun 17 14:52:25.279 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"972vm-test-run-nixbot-gitlab> gitlab # [   10.356350] systemd[1]: Starting linger-users.service...973vm-test-run-nixbot-gitlab> gitlab # [   10.361300] systemd[1]: Started Name Service Cache Daemon (nsncd).974vm-test-run-nixbot-gitlab> gitlab # [   10.383029] systemd[1]: Finished Address configuration of eth1.975vm-test-run-nixbot-gitlab> gitlab # [   10.384390] systemd[1]: Reached target Host and Network Name Lookups.976vm-test-run-nixbot-gitlab> gitlab # [   10.387154] systemd[1]: Reached target User and Group Name Lookups.977vm-test-run-nixbot-gitlab> gitlab # [   10.407145] systemd[1]: linger-users.service: Deactivated successfully.978vm-test-run-nixbot-gitlab> gitlab # [   10.408201] systemd[1]: Finished linger-users.service.979vm-test-run-nixbot-gitlab> gitlab # [   10.434679] dhcpcd[1154]: dhcpcd-10.3.2 starting980vm-test-run-nixbot-gitlab> gitlab # [   10.435433] systemd[1]: Finished Extra networking commands..981vm-test-run-nixbot-gitlab> gitlab # [   10.438788] dhcpcd[1225]: dev: loaded udev982vm-test-run-nixbot-gitlab> gitlab # [   10.446521] systemd[1]: Reached target Network.983vm-test-run-nixbot-gitlab> gitlab # [   10.449913] systemd[1]: Starting gitlab-workhorse.service...984vm-test-run-nixbot-gitlab> gitlab # [   10.452571] 8021q: 802.1Q VLAN Support v1.8985vm-test-run-nixbot-gitlab> gitlab # [   10.452970] 8021q: adding VLAN 0 to HW filter on device eth1986vm-test-run-nixbot-gitlab> gitlab # [   10.459098] systemd[1]: Starting Nginx Web Server...987vm-test-run-nixbot-gitlab> gitlab # [   10.460572] systemd[1]: Starting PostgreSQL Server...988vm-test-run-nixbot-gitlab> gitlab # [   10.481206] systemd[1]: Starting Redis Server - redis-gitlab...989vm-test-run-nixbot-gitlab> gitlab # [   10.482049] systemd[1]: Starting Permit User Sessions...990vm-test-run-nixbot-gitlab> gitlab # [   10.484495] systemd[1]: Starting Virtual Console Setup...991vm-test-run-nixbot-gitlab> gitlab # [   10.492183] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.992vm-test-run-nixbot-gitlab> gitlab # [   10.502331] cfg80211: Loading compiled-in X.509 certificates for regulatory database993vm-test-run-nixbot-gitlab> gitlab # [   10.510612] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'994vm-test-run-nixbot-gitlab> gitlab # [   10.511117] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'995vm-test-run-nixbot-gitlab> gitlab # [   10.512567] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2996vm-test-run-nixbot-gitlab> gitlab # [   10.512886] cfg80211: failed to load regulatory.db997vm-test-run-nixbot-gitlab> gitlab # [   10.517051] systemd[1]: Finished Permit User Sessions.998vm-test-run-nixbot-gitlab> gitlab # [   10.520846] systemd-logind[1086]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)999vm-test-run-nixbot-gitlab> gitlab # [   10.529810] systemd[1]: Started Getty on tty1.1000vm-test-run-nixbot-gitlab> gitlab # [   10.536565] systemd[1]: Reached target Login Prompts.1001vm-test-run-nixbot-gitlab> gitlab # [   10.575056] 8021q: adding VLAN 0 to HW filter on device eth01002vm-test-run-nixbot-gitlab> gitlab # [   10.574590] dhcpcd[1225]: eth0: waiting for carrier1003vm-test-run-nixbot-gitlab> gitlab # [   10.577221] dhcpcd[1225]: eth0: carrier acquired1004vm-test-run-nixbot-gitlab> gitlab # [   10.579459] systemd-vconsole-setup[1233]: Configuration of first virtual console was skipped, ignoring remaining ones.1005vm-test-run-nixbot-gitlab> gitlab # [   10.583319] dhcpcd[1225]: DUID 00:01:00:01:31:c5:71:29:52:54:00:12:34:561006vm-test-run-nixbot-gitlab> gitlab # [   10.584615] dhcpcd[1225]: eth0: IAID 00:12:34:561007vm-test-run-nixbot-gitlab> gitlab # [   10.585314] dhcpcd[1225]: eth0: adding address fe80::5054:ff:fe12:34561008vm-test-run-nixbot-gitlab> gitlab # [   10.594038] systemd[1]: Finished Virtual Console Setup.1009vm-test-run-nixbot-gitlab> gitlab # [   10.643833] nginx-pre-start[1260]: nginx: the configuration file /nix/store/2526shpjv0bzachwf4qi968gxiiyv4kq-nginx.conf syntax is ok1010vm-test-run-nixbot-gitlab> gitlab # [   10.645766] nginx-pre-start[1260]: nginx: configuration file /nix/store/2526shpjv0bzachwf4qi968gxiiyv4kq-nginx.conf test is successful1011vm-test-run-nixbot-gitlab> gitlab # [   10.651147] systemd[1]: Started Nginx Web Server.1012vm-test-run-nixbot-gitlab> gitlab # [   10.662241] redis-server[1257]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1013vm-test-run-nixbot-gitlab> gitlab # [   10.664747] redis-server[1257]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1014vm-test-run-nixbot-gitlab> gitlab # [   10.666028] redis-server[1257]: Redis version=8.8.0, bits=64, commit=00000000, modified=0, pid=1257, just started1015vm-test-run-nixbot-gitlab> gitlab # [   10.667693] redis-server[1257]: Configuration loaded1016vm-test-run-nixbot-gitlab> gitlab # [   10.668735] redis[1257]: monotonic clock: ARM CNTVCT @ 1000 ticks/us1017vm-test-run-nixbot-gitlab> gitlab # [   10.669767] systemd[1]: Started Redis Server - redis-gitlab.1018vm-test-run-nixbot-gitlab> gitlab # [   10.670519] redis[1257]: Running mode=standalone, port=0.1019vm-test-run-nixbot-gitlab> gitlab # [   10.671411] redis[1257]: Server initialized1020vm-test-run-nixbot-gitlab> gitlab # [   10.672232] redis[1257]: Ready to accept connections unix1021vm-test-run-nixbot-gitlab> gitlab # [   10.673122] redis[1257]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1022vm-test-run-nixbot-gitlab> gitlab # [   10.676867] postgresql-pre-start[1264]: The files belonging to this database system will be owned by user "postgres".1023vm-test-run-nixbot-gitlab> gitlab # [   10.679134] postgresql-pre-start[1264]: This user must also own the server process.1024vm-test-run-nixbot-gitlab> gitlab # [   10.680507] postgresql-pre-start[1264]: The database cluster will be initialized with locale "en_US.UTF-8".1025vm-test-run-nixbot-gitlab> gitlab # [   10.682781] postgresql-pre-start[1264]: The default database encoding has accordingly been set to "UTF8".1026vm-test-run-nixbot-gitlab> gitlab # [   10.684200] postgresql-pre-start[1264]: The default text search configuration will be set to "english".1027vm-test-run-nixbot-gitlab> gitlab # [   10.685571] postgresql-pre-start[1264]: Data page checksums are disabled.1028vm-test-run-nixbot-gitlab> gitlab # [   10.686534] postgresql-pre-start[1264]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok1029vm-test-run-nixbot-gitlab> gitlab # [   10.687851] postgresql-pre-start[1264]: creating subdirectories ... ok1030vm-test-run-nixbot-gitlab> gitlab # [   10.688796] postgresql-pre-start[1264]: selecting dynamic shared memory implementation ... posix1031vm-test-run-nixbot-gitlab> gitlab # [   10.714276] postgresql-pre-start[1264]: selecting default "max_connections" ... 1001032vm-test-run-nixbot-gitlab> gitlab # [   10.754499] postgresql-pre-start[1264]: selecting default "shared_buffers" ... 128MB1033vm-test-run-nixbot-gitlab> gitlab # [   10.971034] systemd[1]: Started gitlab-workhorse.service.1034vm-test-run-nixbot-gitlab> gitlab # [   11.177829] postgresql-pre-start[1264]: selecting default time zone ... UTC1035vm-test-run-nixbot-gitlab> gitlab # [   11.181557] postgresql-pre-start[1264]: creating configuration files ... ok1036vm-test-run-nixbot-gitlab> gitlab # [   11.339908] gitlab-workhorse[1290]: time="2026-06-17T14:52:26Z" level=info msg=Starting build_time=19700101.000000 version=18.11.41037vm-test-run-nixbot-gitlab> gitlab # [   11.342493] gitlab-workhorse[1290]: time="2026-06-17T14:52:26Z" level=info msg="Using redis/go-redis"1038vm-test-run-nixbot-gitlab> gitlab # [   11.344335] gitlab-workhorse[1290]: time="2026-06-17T14:52:26Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1039vm-test-run-nixbot-gitlab> gitlab # [   11.440497] dhcpcd[1225]: eth0: soliciting a DHCP lease1040vm-test-run-nixbot-gitlab> gitlab # [   11.443852] postgresql-pre-start[1264]: running bootstrap script ... ok1041vm-test-run-nixbot-gitlab> gitlab # [   11.453101] dhcpcd[1225]: eth0: offered 10.0.2.15 from 10.0.2.21042vm-test-run-nixbot-gitlab> gitlab # [   11.472475] dhcpcd[1225]: eth0: probing address 10.0.2.15/241043vm-test-run-nixbot-gitlab> gitlab # [   12.164084] postgresql-pre-start[1264]: performing post-bootstrap initialization ... ok1044vm-test-run-nixbot-gitlab> gitlab # [   12.386881] postgresql-pre-start[1264]: syncing data to disk ... ok1045vm-test-run-nixbot-gitlab> gitlab # [   12.389737] postgresql-pre-start[1264]: initdb: warning: enabling "trust" authentication for local connections1046vm-test-run-nixbot-gitlab> gitlab # [   12.393546] postgresql-pre-start[1264]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1047vm-test-run-nixbot-gitlab> gitlab # [   12.399802] postgresql-pre-start[1264]: Success. You can now start the database server using:1048vm-test-run-nixbot-gitlab> gitlab # [   12.403604] postgresql-pre-start[1264]:     pg_ctl -D /var/lib/postgresql/17 -l logfile start1049vm-test-run-nixbot-gitlab> gitlab # [   12.544484] postgres[1327]: [1327] LOG:  starting PostgreSQL 17.10 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit1050vm-test-run-nixbot-gitlab> gitlab # [   12.550423] postgres[1327]: [1327] LOG:  listening on IPv6 address "::1", port 54321051vm-test-run-nixbot-gitlab> gitlab # [   12.554585] postgres[1327]: [1327] LOG:  listening on IPv4 address "127.0.0.1", port 54321052vm-test-run-nixbot-gitlab> gitlab # [   12.558363] postgres[1327]: [1327] LOG:  listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1053vm-test-run-nixbot-gitlab> gitlab # [   12.562638] postgres[1335]: [1335] LOG:  database system was shut down at 2026-06-17 14:52:27 GMT1054vm-test-run-nixbot-gitlab> gitlab # [   12.572070] postgres[1327]: [1327] LOG:  database system is ready to accept connections1055vm-test-run-nixbot-gitlab> gitlab # [   12.577867] systemd[1]: Started PostgreSQL Server.1056vm-test-run-nixbot-gitlab> gitlab # [   12.583191] systemd[1]: Starting PostgreSQL Setup Scripts...1057vm-test-run-nixbot-gitlab> gitlab # [   12.591886] c0sj6d459nhf3wg9pm6ziy71l4581qq8-gitlab-config[1324]: mkdir -p /var/gitlab/state/home/.ssh: OK1058vm-test-run-nixbot-gitlab> gitlab # [   12.595653] c0sj6d459nhf3wg9pm6ziy71l4581qq8-gitlab-config[1324]: chmod 700 /var/gitlab/state/home/.ssh: OK1059vm-test-run-nixbot-gitlab> gitlab # [   12.695622] systemd[1]: Finished gitlab-config.service.1060vm-test-run-nixbot-gitlab> gitlab # [   12.704225] systemd[1]: Started gitaly.service.1061vm-test-run-nixbot-gitlab> gitlab # [   12.736806] dhcpcd[1225]: eth0: soliciting an IPv6 router1062vm-test-run-nixbot-gitlab> gitlab # [   12.739132] dhcpcd[1225]: eth0: Router Advertisement from fe80::21063vm-test-run-nixbot-gitlab> gitlab # [   12.741696] dhcpcd[1225]: eth0: adding address fec0::5054:ff:fe12:3456/641064vm-test-run-nixbot-gitlab> gitlab # [   12.744531] dhcpcd[1225]: eth0: adding route to fec0::/641065vm-test-run-nixbot-gitlab> gitlab # [   12.747463] dhcpcd[1225]: eth0: adding default route via fe80::21066vm-test-run-nixbot-gitlab> gitlab # [   12.863725] postgresql-setup-start[1359]: CREATE DATABASE1067vm-test-run-nixbot-gitlab> gitlab # [   12.916847] postgresql-setup-start[1365]: CREATE ROLE1068vm-test-run-nixbot-gitlab> gitlab # [   12.941385] postgresql-setup-start[1367]: ALTER DATABASE1069vm-test-run-nixbot-gitlab> gitlab # [   12.997481] postgresql-setup-start[1372]: CREATE ROLE1070vm-test-run-nixbot-gitlab> gitlab # [   13.003526] systemd[1]: Finished PostgreSQL Setup Scripts.1071vm-test-run-nixbot-gitlab> gitlab # [   13.006093] systemd[1]: Reached target PostgreSQL.1072vm-test-run-nixbot-gitlab> gitlab # [   13.010643] systemd[1]: Starting gitlab-db-config.service...1073vm-test-run-nixbot-gitlab> gitlab # [   13.016215] systemd[1]: Starting gitlab-postgresql.service...1074vm-test-run-nixbot-gitlab> gitlab # [   13.217190] gitlab-postgresql-start[1388]: CREATE DATABASE1075vm-test-run-nixbot-gitlab> gitlab # [   13.297237] gitlab-postgresql-start[1396]: CREATE EXTENSION1076vm-test-run-nixbot-gitlab> gitlab # [   13.362711] gitlab-postgresql-start[1404]: CREATE EXTENSION1077vm-test-run-nixbot-gitlab> gitlab # [   13.365984] systemd[1]: Finished gitlab-postgresql.service.1078vm-test-run-nixbot-gitlab> gitlab # [   13.552357] gitaly[1358]: time="2026-06-17T14:52:28.482Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/krygc3bmd623znp2pddh3fv21q5f3nz2-gitaly.toml' and fix the errors that are printed." pid=13581079vm-test-run-nixbot-gitlab> gitlab # [   13.563160] gitaly[1358]: time="2026-06-17T14:52:28.483Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=13581080vm-test-run-nixbot-gitlab> gitlab # [   13.567888] gitaly[1358]: time="2026-06-17T14:52:28.483Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=13581081vm-test-run-nixbot-gitlab> gitlab # [   13.579923] gitaly[1358]: time="2026-06-17T14:52:28.483Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=13581082vm-test-run-nixbot-gitlab> gitlab # [   13.581746] gitaly[1358]: time="2026-06-17T14:52:28.483Z" level=info msg="Starting Gitaly" pid=1358 version=18.11.41083vm-test-run-nixbot-gitlab> gitlab # [   13.810309] gitaly[1358]: time="2026-06-17T14:52:28.741Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=257 pid=13581084vm-test-run-nixbot-gitlab> gitlab # [   13.812805] gitaly[1358]: time="2026-06-17T14:52:28.743Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=13581085vm-test-run-nixbot-gitlab> gitlab # [   13.814235] gitaly[1358]: time="2026-06-17T14:52:28.744Z" level=info msg="finished initializing command factory" duration_ms=0 pid=13581086vm-test-run-nixbot-gitlab> gitlab # [   13.815653] gitaly[1358]: time="2026-06-17T14:52:28.744Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1358/git-exec-3672223889.d/git pid=13581087vm-test-run-nixbot-gitlab> gitlab # [   13.822193] gitaly[1358]: time="2026-06-17T14:52:28.753Z" level=info msg="finished detecting git version" duration_ms=9 pid=13581088vm-test-run-nixbot-gitlab> gitlab # [   13.823679] gitaly[1358]: time="2026-06-17T14:52:28.753Z" level=info msg="using Git version" pid=1358 version=2.53.g1089vm-test-run-nixbot-gitlab> gitlab # [   13.825954] gitaly[1358]: time="2026-06-17T14:52:28.757Z" level=info msg="clearing disk cache object folder" pid=1358 storage=default1090vm-test-run-nixbot-gitlab> gitlab # [   13.827483] gitaly[1358]: time="2026-06-17T14:52:28.757Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1103859866 pid=1358 storage=default1091vm-test-run-nixbot-gitlab> gitlab # [   13.829919] gitaly[1358]: time="2026-06-17T14:52:28.757Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1103859866 pid=1358 storage=default1092vm-test-run-nixbot-gitlab> gitlab # [   13.832879] gitaly[1358]: time="2026-06-17T14:52:28.757Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=13581093vm-test-run-nixbot-gitlab> gitlab # [   13.836096] gitaly[1358]: time="2026-06-17T14:52:28.757Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=13581094vm-test-run-nixbot-gitlab> gitlab # [   13.839100] gitaly[1358]: time="2026-06-17T14:52:28.757Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1103859866 clear_duration_ms=0 pid=1358 storage=default1095vm-test-run-nixbot-gitlab> gitlab # [   13.842980] gitaly[1358]: time="2026-06-17T14:52:28.772Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=13581096vm-test-run-nixbot-gitlab> gitlab # [   13.845654] gitaly[1358]: time="2026-06-17T14:52:28.772Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1358 schema=unix1097vm-test-run-nixbot-gitlab> gitlab # [   13.847779] gitaly[1358]: time="2026-06-17T14:52:28.772Z" level=info msg="finished tempdir cleaner walk" pid=1358 storage=default time_ms=01098vm-test-run-nixbot-gitlab> gitlab # [   13.849914] gitaly[1358]: time="2026-06-17T14:52:28.772Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1358/sock.d/intern pid=1358 schema=unix1099vm-test-run-nixbot-gitlab> gitlab # [   13.852334] gitaly[1358]: time="2026-06-17T14:52:28.772Z" level=info msg="counting repositories" pid=13581100vm-test-run-nixbot-gitlab> gitlab # [   13.853759] gitaly[1358]: time="2026-06-17T14:52:28.772Z" level=info msg="starting to count repositories" pid=1358 storage_path=/var/gitlab/state/repositories1101vm-test-run-nixbot-gitlab> gitlab # [   13.856132] gitaly[1358]: time="2026-06-17T14:52:28.772Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=1358 storage_path=/var/gitlab/state/repositories1102vm-test-run-nixbot-gitlab> gitlab # [   13.858625] gitaly[1358]: time="2026-06-17T14:52:28.772Z" level=info msg="completed counting all repositories" counting_duration=0 pid=13581103vm-test-run-nixbot-gitlab> gitlab # [   13.860509] gitaly[1358]: time="2026-06-17T14:52:28.774Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=13581104vm-test-run-nixbot-gitlab> gitlab # [   13.862611] gitaly[1358]: time="2026-06-17T14:52:28.774Z" level=info msg="Started Gitaly" duration_ms=290 pid=13581105vm-test-run-nixbot-gitlab> gitlab # [   13.864243] gitaly[1358]: time="2026-06-17T14:52:28.774Z" level=info msg="maintenance: daily scheduled" pid=1358 scheduled="2026-06-18 12:00:00 +0000 UTC"1106vm-test-run-nixbot-gitlab> gitlab # [   14.309465] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1383]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1107vm-test-run-nixbot-gitlab> gitlab # [   14.318198] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1383]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1108vm-test-run-nixbot-gitlab> gitlab # [   14.336252] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1383]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1109vm-test-run-nixbot-gitlab> gitlab # [   16.480237] dhcpcd[1225]: eth0: leased 10.0.2.15 for 86400 seconds1110vm-test-run-nixbot-gitlab> gitlab # [   16.482904] dhcpcd[1225]: eth0: adding route to 10.0.2.0/241111vm-test-run-nixbot-gitlab> gitlab # [   16.485756] dhcpcd[1225]: eth0: adding default route via 10.0.2.21112vm-test-run-nixbot-gitlab> gitlab # [   16.602884] systemd[1]: Started DHCP Client.1113vm-test-run-nixbot-gitlab> gitlab # [   16.605936] systemd[1]: Reached target Network is Online.1114vm-test-run-nixbot-gitlab> gitlab # [   17.244883] gitaly[1358]: time="2026-06-17T14:52:32.175Z" level=info msg="License database preloaded" duration_ms=3691 pid=13581115vm-test-run-nixbot-gitlab> gitlab # [   55.911184] postgres[1838]: [1838] ERROR:  relation "feature_gates" does not exist at character 5231116vm-test-run-nixbot-gitlab> gitlab # [   55.912724] postgres[1838]: [1838] STATEMENT:  SELECT a.attname, format_type(a.atttypid, a.atttypmod),1117vm-test-run-nixbot-gitlab> gitlab # [   55.915978] postgres[1838]: 	       pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1118vm-test-run-nixbot-gitlab> gitlab # [   55.919487] postgres[1838]: 	       c.collname, col_description(a.attrelid, a.attnum) AS comment,1119vm-test-run-nixbot-gitlab> gitlab # [   55.922981] postgres[1838]: 	       attidentity AS identity,1120vm-test-run-nixbot-gitlab> gitlab # [   55.925328] postgres[1838]: 	       attgenerated as attgenerated1121vm-test-run-nixbot-gitlab> gitlab # [   55.927669] postgres[1838]: 	  FROM pg_attribute a1122vm-test-run-nixbot-gitlab> gitlab # [   55.929693] postgres[1838]: 	  LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1123vm-test-run-nixbot-gitlab> gitlab # [   55.933215] postgres[1838]: 	  LEFT JOIN pg_type t ON a.atttypid = t.oid1124vm-test-run-nixbot-gitlab> gitlab # [   55.935741] postgres[1838]: 	  LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1125vm-test-run-nixbot-gitlab> gitlab # [   55.939687] postgres[1838]: 	 WHERE a.attrelid = '"feature_gates"'::regclass1126vm-test-run-nixbot-gitlab> gitlab # [   55.942448] postgres[1838]: 	   AND a.attnum > 0 AND NOT a.attisdropped1127vm-test-run-nixbot-gitlab> gitlab # [   55.945058] postgres[1838]: 	 ORDER BY a.attnum1128vm-test-run-nixbot-gitlab> gitlab # [   55.946872] postgres[1838]:1129vm-test-run-nixbot-gitlab> gitlab # [   56.252259] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1383]: W, [2026-06-17T14:53:11.182689 #1383]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1130vm-test-run-nixbot-gitlab> gitlab # [   61.431108] gitlab-workhorse[1290]: time="2026-06-17T14:53:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1131vm-test-run-nixbot-gitlab> gitlab # [   64.308450] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1911]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE:  extension "btree_gist" already exists, skipping1132vm-test-run-nixbot-gitlab> gitlab # [   64.308886] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1911]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE:  extension "pg_trgm" already exists, skipping1133vm-test-run-nixbot-gitlab> gitlab # [   71.432630] gitlab-workhorse[1290]: time="2026-06-17T14:53:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1134vm-test-run-nixbot-gitlab> gitlab # [   81.442175] gitlab-workhorse[1290]: time="2026-06-17T14:53:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1135vm-test-run-nixbot-gitlab> gitlab # [   87.530520] postgres[2000]: [2000] ERROR:  relation "table_without_models" does not exist1136vm-test-run-nixbot-gitlab> gitlab # [   87.534169] postgres[2000]: [2000] STATEMENT:  SELECT pg_get_serial_sequence('table_without_models', 'id')1137vm-test-run-nixbot-gitlab> gitlab # [   91.450110] gitlab-workhorse[1290]: time="2026-06-17T14:53:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1138vm-test-run-nixbot-gitlab> gitlab # [  101.458374] gitlab-workhorse[1290]: time="2026-06-17T14:53:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1139vm-test-run-nixbot-gitlab> gitlab # [  111.462567] gitlab-workhorse[1290]: time="2026-06-17T14:54:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1140vm-test-run-nixbot-gitlab> gitlab # [  118.476254] systemd[1]: Finished gitlab-db-config.service.1141vm-test-run-nixbot-gitlab> gitlab # [  118.482122] systemd[1]: Started gitlab-sidekiq.service.1142vm-test-run-nixbot-gitlab> gitlab # [  118.488952] systemd[1]: Starting gitlab.service...1143vm-test-run-nixbot-gitlab> gitlab # [  119.086748] bundle[2375]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1144vm-test-run-nixbot-gitlab> gitlab # [  119.092937] bundle[2375]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1145vm-test-run-nixbot-gitlab> gitlab # [  119.098436] bundle[2375]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1146vm-test-run-nixbot-gitlab> gitlab # [  121.472722] gitlab-workhorse[1290]: time="2026-06-17T14:54:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1147vm-test-run-nixbot-gitlab> gitlab # [  123.600460] sidekiq-cluster[2374]: {"severity":"INFO","time":"2026-06-17T14:54:18.500Z","message":"Starting cluster with 1 processes"}1148vm-test-run-nixbot-gitlab> gitlab # [  123.932530] bundle[2375]: {"timestamp":"2026-06-17T14:54:18.823Z","pid":2375,"message":"* Enabling systemd notification integration"}1149vm-test-run-nixbot-gitlab> gitlab # [  123.934195] bundle[2375]: {"timestamp":"2026-06-17T14:54:18.860Z","pid":2375,"message":"Puma starting in cluster mode..."}1150vm-test-run-nixbot-gitlab> gitlab # [  123.935536] bundle[2375]: {"timestamp":"2026-06-17T14:54:18.860Z","pid":2375,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1151vm-test-run-nixbot-gitlab> gitlab # [  123.940165] bundle[2375]: {"timestamp":"2026-06-17T14:54:18.860Z","pid":2375,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1152vm-test-run-nixbot-gitlab> gitlab # [  123.941970] bundle[2375]: {"timestamp":"2026-06-17T14:54:18.861Z","pid":2375,"message":"*  Min threads: 0"}1153vm-test-run-nixbot-gitlab> gitlab # [  123.943157] bundle[2375]: {"timestamp":"2026-06-17T14:54:18.861Z","pid":2375,"message":"*  Max threads: 4"}1154vm-test-run-nixbot-gitlab> gitlab # [  123.952171] bundle[2375]: {"timestamp":"2026-06-17T14:54:18.861Z","pid":2375,"message":"*  Environment: production"}1155vm-test-run-nixbot-gitlab> gitlab # [  123.953527] bundle[2375]: {"timestamp":"2026-06-17T14:54:18.861Z","pid":2375,"message":"*   Master PID: 2375"}1156vm-test-run-nixbot-gitlab> gitlab # [  123.954727] bundle[2375]: {"timestamp":"2026-06-17T14:54:18.861Z","pid":2375,"message":"*      Workers: 2"}1157vm-test-run-nixbot-gitlab> gitlab # [  123.955914] bundle[2375]: {"timestamp":"2026-06-17T14:54:18.861Z","pid":2375,"message":"*     Restarts: (✔) hot (✖) phased (✖) refork"}1158vm-test-run-nixbot-gitlab> gitlab # [  123.960120] bundle[2375]: {"timestamp":"2026-06-17T14:54:18.861Z","pid":2375,"message":"* Preloading application"}1159vm-test-run-nixbot-gitlab> gitlab # [  131.477709] gitlab-workhorse[1290]: time="2026-06-17T14:54:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1160vm-test-run-nixbot-gitlab> gitlab # [  141.478915] gitlab-workhorse[1290]: time="2026-06-17T14:54:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1161vm-test-run-nixbot-gitlab> gitlab # [  151.486121] gitlab-workhorse[1290]: time="2026-06-17T14:54:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1162vm-test-run-nixbot-gitlab> gitlab # [  161.497473] gitlab-workhorse[1290]: time="2026-06-17T14:54:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1163vm-test-run-nixbot-gitlab> gitlab # [  162.391190] bundle[2375]: W, [2026-06-17T14:54:57.321631 #2375]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1164vm-test-run-nixbot-gitlab> gitlab # [  165.428687] sidekiq-cluster[2420]: 2026-06-17T14:55:00.358Z pid=2420 tid=tto INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2420, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>451457024}1165vm-test-run-nixbot-gitlab> gitlab # [  165.737961] sidekiq-cluster[2420]: W, [2026-06-17T14:55:00.669251 #2420]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1166vm-test-run-nixbot-gitlab> gitlab # [  165.800462] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:00.731Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1167vm-test-run-nixbot-gitlab> gitlab # [  169.002631] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:03.932Z","message":"GitLab reliable fetch activated!"}1168vm-test-run-nixbot-gitlab> gitlab # [  169.003020] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:03.933Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1169vm-test-run-nixbot-gitlab> gitlab # [  169.050992] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:03.982Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1170vm-test-run-nixbot-gitlab> gitlab # [  169.057841] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:03.989Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1171vm-test-run-nixbot-gitlab> gitlab # [  169.064187] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:03.995Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1172vm-test-run-nixbot-gitlab> gitlab # [  169.071135] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.001Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1173vm-test-run-nixbot-gitlab> gitlab # [  169.077578] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.007Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1174vm-test-run-nixbot-gitlab> gitlab # [  169.084066] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.012Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1175vm-test-run-nixbot-gitlab> gitlab # [  169.089836] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.015Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1176vm-test-run-nixbot-gitlab> gitlab # [  169.095673] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.019Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1177vm-test-run-nixbot-gitlab> gitlab # [  169.101145] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.022Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1178vm-test-run-nixbot-gitlab> gitlab # [  169.106203] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.026Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1179vm-test-run-nixbot-gitlab> gitlab # [  169.111550] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.029Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1180vm-test-run-nixbot-gitlab> gitlab # [  169.117360] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.033Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1181vm-test-run-nixbot-gitlab> gitlab # [  169.121615] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.035Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1182vm-test-run-nixbot-gitlab> gitlab # [  169.126188] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.038Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1183vm-test-run-nixbot-gitlab> gitlab # [  169.130652] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.041Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1184vm-test-run-nixbot-gitlab> gitlab # [  169.135172] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.045Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1185vm-test-run-nixbot-gitlab> gitlab # [  169.139816] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.048Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1186vm-test-run-nixbot-gitlab> gitlab # [  169.144215] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.053Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1187vm-test-run-nixbot-gitlab> gitlab # [  169.148237] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.057Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1188vm-test-run-nixbot-gitlab> gitlab # [  169.152371] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.061Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1189vm-test-run-nixbot-gitlab> gitlab # [  169.156100] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.065Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1190vm-test-run-nixbot-gitlab> gitlab # [  169.159968] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.068Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1191vm-test-run-nixbot-gitlab> gitlab # [  169.164036] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.072Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1192vm-test-run-nixbot-gitlab> gitlab # [  169.167232] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.075Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1193vm-test-run-nixbot-gitlab> gitlab # [  169.170548] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.077Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1194vm-test-run-nixbot-gitlab> gitlab # [  169.173740] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.080Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1195vm-test-run-nixbot-gitlab> gitlab # [  169.176614] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.084Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1196vm-test-run-nixbot-gitlab> gitlab # [  169.179279] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.087Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1197vm-test-run-nixbot-gitlab> gitlab # [  169.182061] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.090Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1198vm-test-run-nixbot-gitlab> gitlab # [  169.184759] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.093Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1199vm-test-run-nixbot-gitlab> gitlab # [  169.187385] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.096Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1200vm-test-run-nixbot-gitlab> gitlab # [  169.189854] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.098Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1201vm-test-run-nixbot-gitlab> gitlab # [  169.192456] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.101Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1202vm-test-run-nixbot-gitlab> gitlab # [  169.194728] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.104Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1203vm-test-run-nixbot-gitlab> gitlab # [  169.197204] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.107Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1204vm-test-run-nixbot-gitlab> gitlab # [  169.199506] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.109Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1205vm-test-run-nixbot-gitlab> gitlab # [  169.201865] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.111Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1206vm-test-run-nixbot-gitlab> gitlab # [  169.204115] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.114Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1207vm-test-run-nixbot-gitlab> gitlab # [  169.206174] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.116Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1208vm-test-run-nixbot-gitlab> gitlab # [  169.208270] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.118Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1209vm-test-run-nixbot-gitlab> gitlab # [  169.210254] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.120Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1210vm-test-run-nixbot-gitlab> gitlab # [  169.212497] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.122Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1211vm-test-run-nixbot-gitlab> gitlab # [  169.214583] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.124Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1212vm-test-run-nixbot-gitlab> gitlab # [  169.216747] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.127Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1213vm-test-run-nixbot-gitlab> gitlab # [  169.218720] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.130Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1214vm-test-run-nixbot-gitlab> gitlab # [  169.220839] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.132Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1215vm-test-run-nixbot-gitlab> gitlab # [  169.222919] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.135Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1216vm-test-run-nixbot-gitlab> gitlab # [  169.224995] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.137Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1217vm-test-run-nixbot-gitlab> gitlab # [  169.226974] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.139Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1218vm-test-run-nixbot-gitlab> gitlab # [  169.229023] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.142Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1219vm-test-run-nixbot-gitlab> gitlab # [  169.230967] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.145Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1220vm-test-run-nixbot-gitlab> gitlab # [  169.233003] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.148Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1221vm-test-run-nixbot-gitlab> gitlab # [  169.268441] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.199Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1222vm-test-run-nixbot-gitlab> gitlab # [  169.281677] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.213Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1223vm-test-run-nixbot-gitlab> gitlab # [  169.288075] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.216Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1224vm-test-run-nixbot-gitlab> gitlab # [  169.293843] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.220Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1225vm-test-run-nixbot-gitlab> gitlab # [  169.299620] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.222Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1226vm-test-run-nixbot-gitlab> gitlab # [  169.305307] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.225Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1227vm-test-run-nixbot-gitlab> gitlab # [  169.310602] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.228Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1228vm-test-run-nixbot-gitlab> gitlab # [  169.315406] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.232Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1229vm-test-run-nixbot-gitlab> gitlab # [  169.320956] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.234Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1230vm-test-run-nixbot-gitlab> gitlab # [  169.324908] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.238Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1231vm-test-run-nixbot-gitlab> gitlab # [  169.328786] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.240Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1232vm-test-run-nixbot-gitlab> gitlab # [  169.332885] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.245Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1233vm-test-run-nixbot-gitlab> gitlab # [  169.337046] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.249Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1234vm-test-run-nixbot-gitlab> gitlab # [  169.341302] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.251Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1235vm-test-run-nixbot-gitlab> gitlab # [  169.345372] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.255Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1236vm-test-run-nixbot-gitlab> gitlab # [  169.349049] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.257Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1237vm-test-run-nixbot-gitlab> gitlab # [  169.352658] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.259Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1238vm-test-run-nixbot-gitlab> gitlab # [  169.356266] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.261Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1239vm-test-run-nixbot-gitlab> gitlab # [  169.359707] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.264Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1240vm-test-run-nixbot-gitlab> gitlab # [  169.363142] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.266Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1241vm-test-run-nixbot-gitlab> gitlab # [  169.366356] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.268Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1242vm-test-run-nixbot-gitlab> gitlab # [  169.369451] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.270Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1243vm-test-run-nixbot-gitlab> gitlab # [  169.372529] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.272Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1244vm-test-run-nixbot-gitlab> gitlab # [  169.375463] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.275Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1245vm-test-run-nixbot-gitlab> gitlab # [  169.378470] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.277Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1246vm-test-run-nixbot-gitlab> gitlab # [  169.381174] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.280Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1247vm-test-run-nixbot-gitlab> gitlab # [  169.384060] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.282Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1248vm-test-run-nixbot-gitlab> gitlab # [  169.386509] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.283Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1249vm-test-run-nixbot-gitlab> gitlab # [  169.388927] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.286Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1250vm-test-run-nixbot-gitlab> gitlab # [  169.391473] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.288Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1251vm-test-run-nixbot-gitlab> gitlab # [  169.394142] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.290Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1252vm-test-run-nixbot-gitlab> gitlab # [  169.396556] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.293Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1253vm-test-run-nixbot-gitlab> gitlab # [  169.398801] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.297Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1254vm-test-run-nixbot-gitlab> gitlab # [  169.401249] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.299Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1255vm-test-run-nixbot-gitlab> gitlab # [  169.403434] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.301Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1256vm-test-run-nixbot-gitlab> gitlab # [  169.405808] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.304Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1257vm-test-run-nixbot-gitlab> gitlab # [  169.407965] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.307Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1258vm-test-run-nixbot-gitlab> gitlab # [  169.410327] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.310Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1259vm-test-run-nixbot-gitlab> gitlab # [  169.412522] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.312Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1260vm-test-run-nixbot-gitlab> gitlab # [  169.414623] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.315Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1261vm-test-run-nixbot-gitlab> gitlab # [  169.416760] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.316Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1262vm-test-run-nixbot-gitlab> gitlab # [  169.419039] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.319Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1263vm-test-run-nixbot-gitlab> gitlab # [  169.421416] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.321Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1264vm-test-run-nixbot-gitlab> gitlab # [  169.423266] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.325Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1265vm-test-run-nixbot-gitlab> gitlab # [  169.425582] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.328Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1266vm-test-run-nixbot-gitlab> gitlab # [  169.427691] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.331Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1267vm-test-run-nixbot-gitlab> gitlab # [  169.429936] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.333Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1268vm-test-run-nixbot-gitlab> gitlab # [  169.432051] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.347Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1269vm-test-run-nixbot-gitlab> gitlab # [  169.434123] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.349Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1270vm-test-run-nixbot-gitlab> gitlab # [  169.436179] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.352Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1271vm-test-run-nixbot-gitlab> gitlab # [  169.438264] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.355Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1272vm-test-run-nixbot-gitlab> gitlab # [  169.440128] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.358Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1273vm-test-run-nixbot-gitlab> gitlab # [  169.442080] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.361Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1274vm-test-run-nixbot-gitlab> gitlab # [  169.444229] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.364Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1275vm-test-run-nixbot-gitlab> gitlab # [  169.446334] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.366Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1276vm-test-run-nixbot-gitlab> gitlab # [  169.448263] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.368Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1277vm-test-run-nixbot-gitlab> gitlab # [  169.450342] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.372Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1278vm-test-run-nixbot-gitlab> gitlab # [  169.452427] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:04.374Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1279vm-test-run-nixbot-gitlab> gitlab # [  171.506206] gitlab-workhorse[1290]: time="2026-06-17T14:55:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1280vm-test-run-nixbot-gitlab> gitlab # [  181.507412] gitlab-workhorse[1290]: time="2026-06-17T14:55:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1281vm-test-run-nixbot-gitlab> gitlab # [  191.514430] gitlab-workhorse[1290]: time="2026-06-17T14:55:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1282vm-test-run-nixbot-gitlab> gitlab # [  201.515463] gitlab-workhorse[1290]: time="2026-06-17T14:55:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1283vm-test-run-nixbot-gitlab> gitlab # [  208.273140] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:43.204Z","message":"Booted Rails 7.2.3 application in production environment"}1284vm-test-run-nixbot-gitlab> gitlab # [  208.275307] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:43.205Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1285vm-test-run-nixbot-gitlab> gitlab # [  208.277639] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:43.205Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1286vm-test-run-nixbot-gitlab> gitlab # [  208.279666] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:43.205Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1287vm-test-run-nixbot-gitlab> gitlab # [  208.282000] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:43.209Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1288vm-test-run-nixbot-gitlab> gitlab # [  210.971750] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:45.901Z","message":"Cleaning working queues"}1289vm-test-run-nixbot-gitlab> gitlab # [  210.974533] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:45.905Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"91f7a6b66d2bdc169a7ec81f","created_at":"2026-06-17T14:54:12.593Z","trace_propagation_headers":{"sentry-trace":"540daca427a647a2bdc6d0254465ecc1-a5e3fa55a6d3499a","baggage":"sentry-trace_id=540daca427a647a2bdc6d0254465ecc1,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"4266be109d87d1e1960becde4512850f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-17T14:54:12.605Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-91f7a6b66d2bdc169a7ec81f: start","job_status":"start","queue_duration_s":93.299526,"scheduling_latency_s":93.299637}1290vm-test-run-nixbot-gitlab> gitlab # [  211.328242] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:55:46.258Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"91f7a6b66d2bdc169a7ec81f","created_at":"2026-06-17T14:54:12.593Z","trace_propagation_headers":{"sentry-trace":"540daca427a647a2bdc6d0254465ecc1-a5e3fa55a6d3499a","baggage":"sentry-trace_id=540daca427a647a2bdc6d0254465ecc1,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"4266be109d87d1e1960becde4512850f","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-17T14:54:12.605Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-91f7a6b66d2bdc169a7ec81f: done: 0.353526 sec","job_status":"done","queue_duration_s":93.299526,"scheduling_latency_s":93.299637,"redis_calls":29,"redis_duration_s":0.013914,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007736,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.004146,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002032,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.166876,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.16799370000000002,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.353526,"completed_at":"2026-06-17T14:55:46.258Z","load_balancing_strategy":"primary","db_duration_s":0.101163,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1291vm-test-run-nixbot-gitlab> gitlab # [  211.525112] gitlab-workhorse[1290]: time="2026-06-17T14:55:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1292vm-test-run-nixbot-gitlab> gitlab # [  213.137830] bundle[2375]: {"timestamp":"2026-06-17T14:55:48.068Z","pid":2375,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1293vm-test-run-nixbot-gitlab> gitlab # [  213.138157] bundle[2375]: {"timestamp":"2026-06-17T14:55:48.068Z","pid":2375,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1294vm-test-run-nixbot-gitlab> gitlab # [  213.138346] bundle[2375]: {"timestamp":"2026-06-17T14:55:48.068Z","pid":2375,"message":"! #\u003cThread:0x0000fb268abbdb48 /nix/store/09wikq0z4z0s8mkafl8f2b6yp0p78frd-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/09wikq0z4z0s8mkafl8f2b6yp0p78frd-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1295vm-test-run-nixbot-gitlab> gitlab # [  213.138474] bundle[2375]: {"timestamp":"2026-06-17T14:55:48.068Z","pid":2375,"message":"! #\u003cThread:0x0000fb268adb2098 /nix/store/q2bwpwxril8z19gq9b1nnv72drlwhhg8-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/q2bwpwxril8z19gq9b1nnv72drlwhhg8-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1296vm-test-run-nixbot-gitlab> gitlab # [  213.138626] bundle[2375]: {"timestamp":"2026-06-17T14:55:48.068Z","pid":2375,"message":"Use Ctrl-C to stop"}1297vm-test-run-nixbot-gitlab> gitlab # [  213.138763] bundle[2375]: {"timestamp":"2026-06-17T14:55:48.069Z","pid":2375,"message":"Sending status to systemd every 1.0 sec"}1298vm-test-run-nixbot-gitlab> gitlab # [  214.133252] bundle[2375]: {"timestamp":"2026-06-17T14:55:49.064Z","pid":2375,"message":"- Worker 0 (PID: 3230) booted in 0.96s, phase: 0"}1299vm-test-run-nixbot-gitlab> gitlab # [  214.141397] bundle[2375]: {"timestamp":"2026-06-17T14:55:49.071Z","pid":2375,"message":"- Worker 1 (PID: 3234) booted in 0.94s, phase: 0"}1300vm-test-run-nixbot-gitlab> gitlab # [  214.147702] systemd[1]: Started gitlab.service.1301vm-test-run-nixbot-gitlab> gitlab # [  214.148521] systemd[1]: Reached target Common target for all GitLab services..1302vm-test-run-nixbot-gitlab> gitlab # [  214.153704] systemd[1]: Starting setup-gitlab.service...1303vm-test-run-nixbot-gitlab> gitlab # [  214.198699] setup-gitlab-start[3267]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1304vm-test-run-nixbot-gitlab> gitlab # [  217.303458] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:55:52 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 30571305vm-test-run-nixbot-gitlab> gitlab # [  217.312307] setup-gitlab-start[3290]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1306vm-test-run-nixbot-gitlab> gitlab # [  217.319799] setup-gitlab-start[3291]: ++ jq -r .access_token1307vm-test-run-nixbot-gitlab> gitlab # [  218.347247] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:55:53 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 10041308vm-test-run-nixbot-gitlab> gitlab # [  218.354251] setup-gitlab-start[3267]: + BEARER=eb833868d9cf78c3e461b7ab4dbc2d850468baa9b14721e5c84330ca7711b75c1309vm-test-run-nixbot-gitlab> gitlab # [  218.358267] setup-gitlab-start[3267]: + AUTH='Authorization: Bearer eb833868d9cf78c3e461b7ab4dbc2d850468baa9b14721e5c84330ca7711b75c'1310vm-test-run-nixbot-gitlab> gitlab # [  218.362772] setup-gitlab-start[3267]: + curl -fs -X PUT -H 'Authorization: Bearer eb833868d9cf78c3e461b7ab4dbc2d850468baa9b14721e5c84330ca7711b75c' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1311vm-test-run-nixbot-gitlab> gitlab # [  219.317762] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:55:54 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 9501312vm-test-run-nixbot-gitlab> gitlab # [  219.319766] setup-gitlab-start[3267]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1313vm-test-run-nixbot-gitlab> gitlab # [  219.335372] runuser[3310]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1314vm-test-run-nixbot-gitlab> gitlab # [  219.852349] setup-gitlab-start[3311]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1315vm-test-run-nixbot-gitlab> gitlab # [  219.858453] setup-gitlab-start[3311]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1316vm-test-run-nixbot-gitlab> gitlab # [  219.864407] setup-gitlab-start[3311]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1317vm-test-run-nixbot-gitlab> gitlab # [  220.624302] setup-gitlab-start[3311]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1318vm-test-run-nixbot-gitlab> gitlab # [  220.630594] setup-gitlab-start[3311]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1319vm-test-run-nixbot-gitlab> gitlab # [  220.636582] setup-gitlab-start[3311]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1320vm-test-run-nixbot-gitlab> gitlab # [  228.054732] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:02.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"82437f4aacf13cfb10d67aa9","created_at":"2026-06-17T14:56:02.884Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e035eef5032876f97422762aca56b72a","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:02.981Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-82437f4aacf13cfb10d67aa9: start","job_status":"start","queue_duration_s":0.003102,"scheduling_latency_s":0.003147}1321vm-test-run-nixbot-gitlab> gitlab # [  228.268295] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:03.198Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"82437f4aacf13cfb10d67aa9","created_at":"2026-06-17T14:56:02.884Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e035eef5032876f97422762aca56b72a","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:02.981Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-82437f4aacf13cfb10d67aa9: done: 0.213653 sec","job_status":"done","queue_duration_s":0.003102,"scheduling_latency_s":0.003147,"redis_calls":10,"redis_duration_s":0.015669000000000002,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.008809,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004552,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.053196,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00159688,"duration_s":0.213653,"completed_at":"2026-06-17T14:56:03.198Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.049457,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1322vm-test-run-nixbot-gitlab> gitlab # [  228.359379] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:03.261Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a5db20a16e393a175c2c2465","created_at":"2026-06-17T14:56:03.019Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"298d1079fe61016cdac03dd24e7675a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.042Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a5db20a16e393a175c2c2465: start","job_status":"start","queue_duration_s":0.219341,"scheduling_latency_s":0.219389}1323vm-test-run-nixbot-gitlab> gitlab # [  228.415023] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:03.346Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1324vm-test-run-nixbot-gitlab> gitlab # [  228.443521] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:03.373Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"a5db20a16e393a175c2c2465","created_at":"2026-06-17T14:56:03.019Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"298d1079fe61016cdac03dd24e7675a2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.042Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-a5db20a16e393a175c2c2465: done: 0.111728 sec","job_status":"done","queue_duration_s":0.219341,"scheduling_latency_s":0.219389,"redis_calls":10,"redis_duration_s":0.004325,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001523,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002044,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000758,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.045,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.045,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00063784,"duration_s":0.111728,"completed_at":"2026-06-17T14:56:03.373Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.045023,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325vm-test-run-nixbot-gitlab> gitlab # [  228.520437] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:03.379Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7679be52b7f77f53c8c78bbe","created_at":"2026-06-17T14:56:03.064Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"584119d6fe297a2f21df1f96014550ae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.075Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7679be52b7f77f53c8c78bbe: start","job_status":"start","queue_duration_s":0.30355,"scheduling_latency_s":0.303595}1326vm-test-run-nixbot-gitlab> gitlab # [  228.555934] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:03.486Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"7679be52b7f77f53c8c78bbe","created_at":"2026-06-17T14:56:03.064Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"584119d6fe297a2f21df1f96014550ae","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.075Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-7679be52b7f77f53c8c78bbe: done: 0.107875 sec","job_status":"done","queue_duration_s":0.30355,"scheduling_latency_s":0.303595,"redis_calls":13,"redis_duration_s":0.016271,"redis_read_bytes":139,"redis_write_bytes":1636,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.009951,"redis_feature_flag_read_bytes":132,"redis_feature_flag_write_bytes":698,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004273,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002047,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.043022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00191756,"duration_s":0.107875,"completed_at":"2026-06-17T14:56:03.486Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013753,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327vm-test-run-nixbot-gitlab> gitlab # [  228.612165] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:03.497Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"23457ff1c6f21b47f2b786d3","created_at":"2026-06-17T14:56:03.098Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"942bf4d4fe937f77ac92e6c60f9bd7de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-17T14:56:03.112Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-23457ff1c6f21b47f2b786d3: start","job_status":"start","queue_duration_s":0.384599,"scheduling_latency_s":0.384645}1328vm-test-run-nixbot-gitlab> gitlab # [  228.681347] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:03.612Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"23457ff1c6f21b47f2b786d3","created_at":"2026-06-17T14:56:03.098Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"942bf4d4fe937f77ac92e6c60f9bd7de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-17T14:56:03.112Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-23457ff1c6f21b47f2b786d3: done: 0.114819 sec","job_status":"done","queue_duration_s":0.384599,"scheduling_latency_s":0.384645,"redis_calls":10,"redis_duration_s":0.018000000000000002,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000964,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003291,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.049048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00115802,"duration_s":0.114819,"completed_at":"2026-06-17T14:56:03.612Z","load_balancing_strategy":"primary","db_duration_s":0.014763,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329vm-test-run-nixbot-gitlab> gitlab # [  228.740858] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:03.627Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4a770dbc2e637ce2e65fc001","created_at":"2026-06-17T14:56:03.129Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c54dd05b1a09f8e7aa86874a1baa5c56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.157Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4a770dbc2e637ce2e65fc001: start","job_status":"start","queue_duration_s":0.470346,"scheduling_latency_s":0.470394}1330vm-test-run-nixbot-gitlab> gitlab # [  229.383241] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:04.312Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"4a770dbc2e637ce2e65fc001","created_at":"2026-06-17T14:56:03.129Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c54dd05b1a09f8e7aa86874a1baa5c56","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.157Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-4a770dbc2e637ce2e65fc001: done: 0.685495 sec","job_status":"done","queue_duration_s":0.470346,"scheduling_latency_s":0.470394,"redis_calls":12,"redis_duration_s":0.015462,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00401,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.007902,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00355,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.047,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.380447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00213562,"exclusive_lock_hold_duration_s":0.54781598,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.685495,"completed_at":"2026-06-17T14:56:04.312Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.061037,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331vm-test-run-nixbot-gitlab> gitlab # [  229.384314] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:04.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"989c939cf5e0b286db6b4f39","created_at":"2026-06-17T14:56:03.192Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df7d55e0debd461ac41ae67e6f0c8046","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.208Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-989c939cf5e0b286db6b4f39: start","job_status":"start","queue_duration_s":1.107348,"scheduling_latency_s":1.107376}1332vm-test-run-nixbot-gitlab> gitlab # [  229.528677] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:04.458Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"989c939cf5e0b286db6b4f39","created_at":"2026-06-17T14:56:03.192Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"df7d55e0debd461ac41ae67e6f0c8046","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.208Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-989c939cf5e0b286db6b4f39: done: 0.143221 sec","job_status":"done","queue_duration_s":1.107348,"scheduling_latency_s":1.107376,"redis_calls":10,"redis_duration_s":0.0034739999999999997,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00061,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00209,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000774,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.092,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.092,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00096304,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.143221,"completed_at":"2026-06-17T14:56:04.458Z","load_balancing_strategy":"primary","db_duration_s":0.094559,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333vm-test-run-nixbot-gitlab> gitlab # [  229.642772] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:04.462Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"6737fbd090ba869e96da4df0","created_at":"2026-06-17T14:56:03.214Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27fce56d8ca56979f011e7c1c144771e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.225Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-6737fbd090ba869e96da4df0: start","job_status":"start","queue_duration_s":1.237423,"scheduling_latency_s":1.237464}1334vm-test-run-nixbot-gitlab> gitlab # [  229.862252] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:04.793Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"6737fbd090ba869e96da4df0","created_at":"2026-06-17T14:56:03.214Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27fce56d8ca56979f011e7c1c144771e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.225Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-6737fbd090ba869e96da4df0: done: 0.330717 sec","job_status":"done","queue_duration_s":1.237423,"scheduling_latency_s":1.237464,"redis_calls":14,"redis_duration_s":0.005520000000000001,"redis_read_bytes":13,"redis_write_bytes":1645,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00204,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":580,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001974,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001506,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.054,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":125,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":80,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.054,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.251421,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00119932,"exclusive_lock_hold_duration_s":0.28068758,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.330717,"completed_at":"2026-06-17T14:56:04.793Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.08161,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335vm-test-run-nixbot-gitlab> gitlab # [  229.963495] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:04.795Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"12b16c6ee909f85744b14c00","created_at":"2026-06-17T14:56:03.236Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"acc242580164f2efbe891ef086129ea3","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.244Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-12b16c6ee909f85744b14c00: start","job_status":"start","queue_duration_s":1.550278,"scheduling_latency_s":1.550298}1336vm-test-run-nixbot-gitlab> gitlab # [  229.986275] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:04.817Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"12b16c6ee909f85744b14c00","created_at":"2026-06-17T14:56:03.236Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"acc242580164f2efbe891ef086129ea3","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.244Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-12b16c6ee909f85744b14c00: done: 0.022454 sec","job_status":"done","queue_duration_s":1.550278,"scheduling_latency_s":1.550298,"redis_calls":10,"redis_duration_s":0.002633,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000531,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001613,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000489,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036576,"duration_s":0.022454,"completed_at":"2026-06-17T14:56:04.817Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000689,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337vm-test-run-nixbot-gitlab> gitlab # [  230.033497] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:04.819Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e539a371b197daca844eaa81","created_at":"2026-06-17T14:56:03.258Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"442498c9f6f2478b98aaaabb4da6208c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.269Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e539a371b197daca844eaa81: start","job_status":"start","queue_duration_s":1.54936,"scheduling_latency_s":1.549377}1338vm-test-run-nixbot-gitlab> gitlab # [  230.046564] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:04.858Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"e539a371b197daca844eaa81","created_at":"2026-06-17T14:56:03.258Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"442498c9f6f2478b98aaaabb4da6208c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.269Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-e539a371b197daca844eaa81: done: 0.039304 sec","job_status":"done","queue_duration_s":1.54936,"scheduling_latency_s":1.549377,"redis_calls":19,"redis_duration_s":0.004453,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000999,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000364,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002329,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000761,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026295,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032266,"duration_s":0.039304,"completed_at":"2026-06-17T14:56:04.858Z","load_balancing_strategy":"primary","db_duration_s":0.003405,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339vm-test-run-nixbot-gitlab> gitlab # [  230.086827] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:04.860Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ae6c1c1f8cd13b222e65d0a8","created_at":"2026-06-17T14:56:03.344Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2b03a55f02f5e46ef4071159449a1da","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-17T14:56:03.381Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ae6c1c1f8cd13b222e65d0a8: start","job_status":"start","queue_duration_s":1.478138,"scheduling_latency_s":1.478154}1340vm-test-run-nixbot-gitlab> gitlab # [  230.099524] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:04.873Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1341vm-test-run-nixbot-gitlab> gitlab # [  230.102780] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:04.881Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"ae6c1c1f8cd13b222e65d0a8","created_at":"2026-06-17T14:56:03.344Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e2b03a55f02f5e46ef4071159449a1da","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-17T14:56:03.381Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-ae6c1c1f8cd13b222e65d0a8: done: 0.020929 sec","job_status":"done","queue_duration_s":1.478138,"scheduling_latency_s":1.478154,"redis_calls":10,"redis_duration_s":0.002631,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000545,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001536,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00055,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034978,"duration_s":0.020929,"completed_at":"2026-06-17T14:56:04.880Z","load_balancing_strategy":"primary","db_duration_s":0.00072,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342vm-test-run-nixbot-gitlab> gitlab # [  230.142340] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:04.882Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"cca80bb52fe41f85af9a6202","created_at":"2026-06-17T14:56:03.418Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e2a7a60b1513a6432d9bb14c5abe9a5","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.447Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-cca80bb52fe41f85af9a6202: start","job_status":"start","queue_duration_s":1.435734,"scheduling_latency_s":1.435752}1343vm-test-run-nixbot-gitlab> gitlab # [  230.273038] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.204Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"cca80bb52fe41f85af9a6202","created_at":"2026-06-17T14:56:03.418Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e2a7a60b1513a6432d9bb14c5abe9a5","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.447Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-cca80bb52fe41f85af9a6202: done: 0.32131 sec","job_status":"done","queue_duration_s":1.435734,"scheduling_latency_s":1.435752,"redis_calls":574,"redis_duration_s":0.06792,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000495,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001115,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.06631,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.283073,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026482,"duration_s":0.32131,"completed_at":"2026-06-17T14:56:05.204Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000634,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1344vm-test-run-nixbot-gitlab> gitlab # [  230.312835] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.205Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"29b2bc8e281cfaa40244b643","created_at":"2026-06-17T14:56:03.481Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d06ae0a3d5aa269e6366ac8e52d7b08","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.500Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-29b2bc8e281cfaa40244b643: start","job_status":"start","queue_duration_s":1.705313,"scheduling_latency_s":1.705333}1345vm-test-run-nixbot-gitlab> gitlab # [  230.326649] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.235Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"29b2bc8e281cfaa40244b643","created_at":"2026-06-17T14:56:03.481Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6d06ae0a3d5aa269e6366ac8e52d7b08","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.500Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-29b2bc8e281cfaa40244b643: done: 0.029418 sec","job_status":"done","queue_duration_s":1.705313,"scheduling_latency_s":1.705333,"redis_calls":12,"redis_duration_s":0.003699,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000438,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002211,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00105,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016735,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058698,"exclusive_lock_hold_duration_s":0.0059156,"duration_s":0.029418,"completed_at":"2026-06-17T14:56:05.235Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003325,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1346vm-test-run-nixbot-gitlab> gitlab # [  230.368371] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.236Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9998a299292c150c93c58ab8","created_at":"2026-06-17T14:56:03.532Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4749aed608bee6667539b367fa98e9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.577Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9998a299292c150c93c58ab8: start","job_status":"start","queue_duration_s":1.65948,"scheduling_latency_s":1.659497}1347vm-test-run-nixbot-gitlab> gitlab # [  230.381842] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.267Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9998a299292c150c93c58ab8","created_at":"2026-06-17T14:56:03.532Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4749aed608bee6667539b367fa98e9f9","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.577Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9998a299292c150c93c58ab8: done: 0.030713 sec","job_status":"done","queue_duration_s":1.65948,"scheduling_latency_s":1.659497,"redis_calls":12,"redis_duration_s":0.003493,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001721,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001323,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016755,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00049346,"exclusive_lock_hold_duration_s":0.0079418,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.030713,"completed_at":"2026-06-17T14:56:05.267Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004586,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1348vm-test-run-nixbot-gitlab> gitlab # [  230.423081] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.269Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e38b4abb0e9e5c9661f5663a","created_at":"2026-06-17T14:56:03.606Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8dcb1f95634daa8d9b9bd06b27fbca70","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.621Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e38b4abb0e9e5c9661f5663a: start","job_status":"start","queue_duration_s":1.648587,"scheduling_latency_s":1.648607}1349vm-test-run-nixbot-gitlab> gitlab # [  230.437078] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.313Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"e38b4abb0e9e5c9661f5663a","created_at":"2026-06-17T14:56:03.606Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8dcb1f95634daa8d9b9bd06b27fbca70","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.621Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-e38b4abb0e9e5c9661f5663a: done: 0.044055 sec","job_status":"done","queue_duration_s":1.648587,"scheduling_latency_s":1.648607,"redis_calls":13,"redis_duration_s":0.004229,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000749,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002047,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001433,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02636,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01626992,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.044055,"completed_at":"2026-06-17T14:56:05.313Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.007904,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1350vm-test-run-nixbot-gitlab> gitlab # [  230.480167] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9196375fb534d6baa4205f12","created_at":"2026-06-17T14:56:03.635Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.648Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9196375fb534d6baa4205f12: start","job_status":"start","queue_duration_s":1.667239,"scheduling_latency_s":1.667257}1351vm-test-run-nixbot-gitlab> gitlab # [  230.505351] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.436Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"9196375fb534d6baa4205f12","created_at":"2026-06-17T14:56:03.635Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.648Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-9196375fb534d6baa4205f12: done: 0.120657 sec","job_status":"done","queue_duration_s":1.667239,"scheduling_latency_s":1.667257,"redis_calls":71,"redis_duration_s":0.019596,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002657,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000981,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.015182,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000776,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003823,"duration_s":0.120657,"completed_at":"2026-06-17T14:56:05.436Z","load_balancing_strategy":"primary","db_duration_s":0.002993,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352vm-test-run-nixbot-gitlab> gitlab # [  230.547461] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.438Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4f25d31d65b012a691df0ec2","created_at":"2026-06-17T14:56:03.679Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a546313f5c2fd57a0cd7d79fdc234f52","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.706Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4f25d31d65b012a691df0ec2: start","job_status":"start","queue_duration_s":1.731345,"scheduling_latency_s":1.73137}1353vm-test-run-nixbot-gitlab> gitlab # [  230.562360] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.462Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"4f25d31d65b012a691df0ec2","created_at":"2026-06-17T14:56:03.679Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a546313f5c2fd57a0cd7d79fdc234f52","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.706Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-4f25d31d65b012a691df0ec2: done: 0.02449 sec","job_status":"done","queue_duration_s":1.731345,"scheduling_latency_s":1.73137,"redis_calls":10,"redis_duration_s":0.002924,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000625,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001733,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000566,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014064,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039208,"duration_s":0.02449,"completed_at":"2026-06-17T14:56:05.462Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000863,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1354vm-test-run-nixbot-gitlab> gitlab # [  230.602737] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.464Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4ecdf661f669e40c1841d6ce","created_at":"2026-06-17T14:56:03.719Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8364bbff1a968ca65e061ba77066833","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.743Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4ecdf661f669e40c1841d6ce: start","job_status":"start","queue_duration_s":1.721402,"scheduling_latency_s":1.721423}1355vm-test-run-nixbot-gitlab> gitlab # [  230.616805] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.480Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1356vm-test-run-nixbot-gitlab> gitlab # [  230.620209] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.488Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"4ecdf661f669e40c1841d6ce","created_at":"2026-06-17T14:56:03.719Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d8364bbff1a968ca65e061ba77066833","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.743Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-4ecdf661f669e40c1841d6ce: done: 0.023997 sec","job_status":"done","queue_duration_s":1.721402,"scheduling_latency_s":1.721423,"redis_calls":10,"redis_duration_s":0.003077,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000718,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001736,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000623,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003934,"duration_s":0.023997,"completed_at":"2026-06-17T14:56:05.488Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000855,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357vm-test-run-nixbot-gitlab> gitlab # [  230.660996] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4fd82e139a3dcfd8e21e2ed6","created_at":"2026-06-17T14:56:03.784Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9eaf0ae95b30402b7d294782b299ab55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-17T14:56:03.818Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4fd82e139a3dcfd8e21e2ed6: start","job_status":"start","queue_duration_s":1.672384,"scheduling_latency_s":1.672405}1358vm-test-run-nixbot-gitlab> gitlab # [  230.673950] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.505Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1359vm-test-run-nixbot-gitlab> gitlab # [  230.677565] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.514Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"4fd82e139a3dcfd8e21e2ed6","created_at":"2026-06-17T14:56:03.784Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9eaf0ae95b30402b7d294782b299ab55","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-17T14:56:03.818Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-4fd82e139a3dcfd8e21e2ed6: done: 0.024187 sec","job_status":"done","queue_duration_s":1.672384,"scheduling_latency_s":1.672405,"redis_calls":10,"redis_duration_s":0.003048,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000685,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001745,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000618,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044616,"duration_s":0.024187,"completed_at":"2026-06-17T14:56:05.514Z","load_balancing_strategy":"primary","db_duration_s":0.000821,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1360vm-test-run-nixbot-gitlab> gitlab # [  230.717823] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.516Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"6830c5c1eefb2af63d9f1b29","created_at":"2026-06-17T14:56:03.865Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c3f8731e4cfe9c9ce14484261c63f8e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.874Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-6830c5c1eefb2af63d9f1b29: start","job_status":"start","queue_duration_s":1.641998,"scheduling_latency_s":1.642018}1361vm-test-run-nixbot-gitlab> gitlab # [  230.731851] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.532Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1362vm-test-run-nixbot-gitlab> gitlab # [  230.735107] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"6830c5c1eefb2af63d9f1b29","created_at":"2026-06-17T14:56:03.865Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c3f8731e4cfe9c9ce14484261c63f8e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.874Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-6830c5c1eefb2af63d9f1b29: done: 0.023742 sec","job_status":"done","queue_duration_s":1.641998,"scheduling_latency_s":1.642018,"redis_calls":10,"redis_duration_s":0.0030819999999999997,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000757,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001687,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038152,"duration_s":0.023742,"completed_at":"2026-06-17T14:56:05.540Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00087,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363vm-test-run-nixbot-gitlab> gitlab # [  230.777718] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.542Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"60d1621a6122de25ad4ddab5","created_at":"2026-06-17T14:56:03.884Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c75f15219bb281a0e65a582baa3ae7e","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.892Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-60d1621a6122de25ad4ddab5: start","job_status":"start","queue_duration_s":1.649193,"scheduling_latency_s":1.649211}1364vm-test-run-nixbot-gitlab> gitlab # [  230.790653] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.565Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"60d1621a6122de25ad4ddab5","created_at":"2026-06-17T14:56:03.884Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4c75f15219bb281a0e65a582baa3ae7e","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.892Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-60d1621a6122de25ad4ddab5: done: 0.023709 sec","job_status":"done","queue_duration_s":1.649193,"scheduling_latency_s":1.649211,"redis_calls":12,"redis_duration_s":0.003388,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000582,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000658,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001597,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013519,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039882,"duration_s":0.023709,"completed_at":"2026-06-17T14:56:05.565Z","load_balancing_strategy":"primary","db_duration_s":0.000746,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365vm-test-run-nixbot-gitlab> gitlab # [  230.831779] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.567Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e3463f11e461a95a6ef37536","created_at":"2026-06-17T14:56:03.913Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17a4e72b0dbf5a35b55726ec70a94bcf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.922Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e3463f11e461a95a6ef37536: start","job_status":"start","queue_duration_s":1.645487,"scheduling_latency_s":1.645506}1366vm-test-run-nixbot-gitlab> gitlab # [  230.846267] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.582Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1367vm-test-run-nixbot-gitlab> gitlab # [  230.849965] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.590Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"e3463f11e461a95a6ef37536","created_at":"2026-06-17T14:56:03.913Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"17a4e72b0dbf5a35b55726ec70a94bcf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.922Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-e3463f11e461a95a6ef37536: done: 0.023376 sec","job_status":"done","queue_duration_s":1.645487,"scheduling_latency_s":1.645506,"redis_calls":10,"redis_duration_s":0.002969,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000668,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001735,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000566,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01309,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003854,"duration_s":0.023376,"completed_at":"2026-06-17T14:56:05.590Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000832,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1368vm-test-run-nixbot-gitlab> gitlab # [  230.891498] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.592Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"54c35d407e0b86f0a6befb08","created_at":"2026-06-17T14:56:03.944Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a94d6ec369b6d73f8aef2ea95eda56a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.951Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-54c35d407e0b86f0a6befb08: start","job_status":"start","queue_duration_s":1.641437,"scheduling_latency_s":1.641458}1369vm-test-run-nixbot-gitlab> gitlab # [  230.905763] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.663Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"54c35d407e0b86f0a6befb08","created_at":"2026-06-17T14:56:03.944Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a94d6ec369b6d73f8aef2ea95eda56a7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.951Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-54c35d407e0b86f0a6befb08: done: 0.070642 sec","job_status":"done","queue_duration_s":1.641437,"scheduling_latency_s":1.641458,"redis_calls":14,"redis_duration_s":0.004865,"redis_read_bytes":13,"redis_write_bytes":1883,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001297,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":618,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002027,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001541,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":8,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.026,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00068048,"exclusive_lock_hold_duration_s":0.04151774,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.070642,"completed_at":"2026-06-17T14:56:05.663Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.028784,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1370vm-test-run-nixbot-gitlab> gitlab # [  230.949059] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.665Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"733f53641c70974ed9293a8f","created_at":"2026-06-17T14:56:03.965Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4827333fbac150097b641d9e9ba9577f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.973Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-733f53641c70974ed9293a8f: start","job_status":"start","queue_duration_s":1.69144,"scheduling_latency_s":1.69146}1371vm-test-run-nixbot-gitlab> gitlab # [  230.963918] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.836Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"733f53641c70974ed9293a8f","created_at":"2026-06-17T14:56:03.965Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4827333fbac150097b641d9e9ba9577f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.973Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-733f53641c70974ed9293a8f: done: 0.170853 sec","job_status":"done","queue_duration_s":1.69144,"scheduling_latency_s":1.69146,"redis_calls":16,"redis_duration_s":0.004544,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002458,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001548,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000538,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.148383,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00036666,"duration_s":0.170853,"completed_at":"2026-06-17T14:56:05.836Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010898,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1372vm-test-run-nixbot-gitlab> gitlab # [  231.004858] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.838Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ExpireBuildArtifactsWorker","jid":"833ca9c24172ffc67bfe182b","created_at":"2026-06-17T14:56:03.982Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"caf441858bb1c93841076ad30629604b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:7be9ea93da0bda6381b334cf2932692b41842a57ea0aeac11899369225b9bb7e","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.988Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ExpireBuildArtifactsWorker JID-833ca9c24172ffc67bfe182b: start","job_status":"start","queue_duration_s":1.849507,"scheduling_latency_s":1.849532}1373vm-test-run-nixbot-gitlab> gitlab # [  231.017539] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.861Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ExpireBuildArtifactsWorker","jid":"833ca9c24172ffc67bfe182b","created_at":"2026-06-17T14:56:03.982Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"caf441858bb1c93841076ad30629604b","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:7be9ea93da0bda6381b334cf2932692b41842a57ea0aeac11899369225b9bb7e","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.988Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ExpireBuildArtifactsWorker JID-833ca9c24172ffc67bfe182b: done: 0.023134 sec","job_status":"done","queue_duration_s":1.849507,"scheduling_latency_s":1.849532,"redis_calls":10,"redis_duration_s":0.003046,"redis_read_bytes":9,"redis_write_bytes":1035,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00074,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001709,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000597,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039046,"duration_s":0.023134,"completed_at":"2026-06-17T14:56:05.861Z","load_balancing_strategy":"primary","db_duration_s":0.000934,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1374vm-test-run-nixbot-gitlab> gitlab # [  231.057139] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.863Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"bd2e16532287296b7b5854db","created_at":"2026-06-17T14:56:03.993Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac20862354deba161942b1d36ec8185c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.999Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-bd2e16532287296b7b5854db: start","job_status":"start","queue_duration_s":1.863584,"scheduling_latency_s":1.863606}1375vm-test-run-nixbot-gitlab> gitlab # [  231.070227] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.902Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"bd2e16532287296b7b5854db","created_at":"2026-06-17T14:56:03.993Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ac20862354deba161942b1d36ec8185c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:03.999Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-bd2e16532287296b7b5854db: done: 0.039447 sec","job_status":"done","queue_duration_s":1.863584,"scheduling_latency_s":1.863606,"redis_calls":12,"redis_duration_s":0.0045769999999999995,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000656,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00188,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002041,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00073666,"exclusive_lock_hold_duration_s":0.0123163,"duration_s":0.039447,"completed_at":"2026-06-17T14:56:05.902Z","load_balancing_strategy":"primary","db_duration_s":0.008127,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1376vm-test-run-nixbot-gitlab> gitlab # [  231.110433] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.904Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2105948a4c8b6e259f03bc6d","created_at":"2026-06-17T14:56:04.011Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fbcc4eaaf8002d1912e2c11837916e2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:04.017Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2105948a4c8b6e259f03bc6d: start","job_status":"start","queue_duration_s":1.887491,"scheduling_latency_s":1.887512}1377vm-test-run-nixbot-gitlab> gitlab # [  231.123972] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.960Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"2105948a4c8b6e259f03bc6d","created_at":"2026-06-17T14:56:04.011Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2fbcc4eaaf8002d1912e2c11837916e2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:04.017Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-2105948a4c8b6e259f03bc6d: done: 0.056103 sec","job_status":"done","queue_duration_s":1.887491,"scheduling_latency_s":1.887512,"redis_calls":10,"redis_duration_s":0.022403,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000912,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.017269,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.004222,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021779,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00068364,"duration_s":0.056103,"completed_at":"2026-06-17T14:56:05.960Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005993,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1378vm-test-run-nixbot-gitlab> gitlab # [  231.165856] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:05.963Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"151fa4d1f4928d1e4684f5a5","created_at":"2026-06-17T14:56:04.021Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1d09fce723fdc39cb7cfac182994e4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:04.027Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-151fa4d1f4928d1e4684f5a5: start","job_status":"start","queue_duration_s":1.935991,"scheduling_latency_s":1.936022}1379vm-test-run-nixbot-gitlab> gitlab # [  231.285045] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::UpdateLockedUnknownArtifactsWorker","jid":"151fa4d1f4928d1e4684f5a5","created_at":"2026-06-17T14:56:04.021Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d1d09fce723fdc39cb7cfac182994e4a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:912858db94fb8c9da5e144f8394730b16dbb4d7f396606379d4f42078eef6e20","size_limiter":"validated","enqueued_at":"2026-06-17T14:56:04.027Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UpdateLockedUnknownArtifactsWorker JID-151fa4d1f4928d1e4684f5a5: done: 0.251413 sec","job_status":"done","queue_duration_s":1.935991,"scheduling_latency_s":1.936022,"redis_calls":12,"redis_duration_s":0.005768,"redis_read_bytes":11,"redis_write_bytes":1447,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000872,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":319,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002313,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002583,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":542,"db_count":101,"db_write_count":0,"db_cached_count":99,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":101,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":99,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":100,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":99,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.20364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0012047,"exclusive_lock_hold_duration_s":0.2107902,"extra.ci_update_locked_unknown_artifacts_worker.removed_count":0,"extra.ci_update_locked_unknown_artifacts_worker.locked_count":0,"duration_s":0.251413,"completed_at":"2026-06-17T14:56:06.214Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.03302,"urgency":"throttled","target_duration_s":300,"target_scheduling_latency_s":null}1380vm-test-run-nixbot-gitlab> gitlab # [  231.337099] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.218Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"83d54cf5ef1b61775f832b7e","created_at":"2026-06-17T14:56:04.836Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-01611daf7f484a34","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"442498c9f6f2478b98aaaabb4da6208c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:04.850Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-83d54cf5ef1b61775f832b7e: start","job_status":"start","queue_duration_s":1.367738,"scheduling_latency_s":1.367769}1381vm-test-run-nixbot-gitlab> gitlab # [  231.350978] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.244Z","message":"No existing merge request to be cleaned up."}1382vm-test-run-nixbot-gitlab> gitlab # [  231.352745] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.263Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"83d54cf5ef1b61775f832b7e","created_at":"2026-06-17T14:56:04.836Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-01611daf7f484a34","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"442498c9f6f2478b98aaaabb4da6208c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:04.850Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-83d54cf5ef1b61775f832b7e: done: 0.044992 sec","job_status":"done","queue_duration_s":1.367738,"scheduling_latency_s":1.367769,"redis_calls":13,"redis_duration_s":0.004948,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000812,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001618,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002518,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038226,"duration_s":0.044992,"completed_at":"2026-06-17T14:56:06.263Z","load_balancing_strategy":"primary","db_duration_s":0.006999,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383vm-test-run-nixbot-gitlab> gitlab # [  231.392845] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.265Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a308937747d98addb1bf472d","created_at":"2026-06-17T14:56:04.836Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-01611daf7f484a34","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"442498c9f6f2478b98aaaabb4da6208c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:04.850Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a308937747d98addb1bf472d: start","job_status":"start","queue_duration_s":1.414517,"scheduling_latency_s":1.41454}1384vm-test-run-nixbot-gitlab> gitlab # [  231.404417] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.279Z","message":"No existing merge request to be cleaned up."}1385vm-test-run-nixbot-gitlab> gitlab # [  231.405973] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.291Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a308937747d98addb1bf472d","created_at":"2026-06-17T14:56:04.836Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-01611daf7f484a34","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"442498c9f6f2478b98aaaabb4da6208c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:04.850Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a308937747d98addb1bf472d: done: 0.026506 sec","job_status":"done","queue_duration_s":1.414517,"scheduling_latency_s":1.41454,"redis_calls":10,"redis_duration_s":0.0029500000000000004,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001226,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001724,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026506,"completed_at":"2026-06-17T14:56:06.291Z","load_balancing_strategy":"primary","db_duration_s":0.003153,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1386vm-test-run-nixbot-gitlab> gitlab # [  231.442925] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.293Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"93fcebc33d26b0a7b8d27ae3","created_at":"2026-06-17T14:56:04.836Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-01611daf7f484a34","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"442498c9f6f2478b98aaaabb4da6208c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:04.850Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-93fcebc33d26b0a7b8d27ae3: start","job_status":"start","queue_duration_s":1.442769,"scheduling_latency_s":1.442793}1387vm-test-run-nixbot-gitlab> gitlab # [  231.454737] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.307Z","message":"No existing merge request to be cleaned up."}1388vm-test-run-nixbot-gitlab> gitlab # [  231.456344] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.319Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"93fcebc33d26b0a7b8d27ae3","created_at":"2026-06-17T14:56:04.836Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-01611daf7f484a34","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"442498c9f6f2478b98aaaabb4da6208c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:04.850Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-93fcebc33d26b0a7b8d27ae3: done: 0.025906 sec","job_status":"done","queue_duration_s":1.442769,"scheduling_latency_s":1.442793,"redis_calls":10,"redis_duration_s":0.002975,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001276,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001699,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025906,"completed_at":"2026-06-17T14:56:06.319Z","load_balancing_strategy":"primary","db_duration_s":0.003071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389vm-test-run-nixbot-gitlab> gitlab # [  231.492404] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.321Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"df3c8296933727b4526ab887","created_at":"2026-06-17T14:56:04.836Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-01611daf7f484a34","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"442498c9f6f2478b98aaaabb4da6208c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:04.850Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-df3c8296933727b4526ab887: start","job_status":"start","queue_duration_s":1.470501,"scheduling_latency_s":1.47053}1390vm-test-run-nixbot-gitlab> gitlab # [  231.503844] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.337Z","message":"No existing merge request to be cleaned up."}1391vm-test-run-nixbot-gitlab> gitlab # [  231.505513] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.348Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"df3c8296933727b4526ab887","created_at":"2026-06-17T14:56:04.836Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-01611daf7f484a34","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"442498c9f6f2478b98aaaabb4da6208c","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:04.850Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-df3c8296933727b4526ab887: done: 0.026974 sec","job_status":"done","queue_duration_s":1.470501,"scheduling_latency_s":1.47053,"redis_calls":10,"redis_duration_s":0.004507,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001779,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002728,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017014,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026974,"completed_at":"2026-06-17T14:56:06.348Z","load_balancing_strategy":"primary","db_duration_s":0.003143,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1392vm-test-run-nixbot-gitlab> gitlab # [  231.541959] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.350Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b8622cb7f57cec67b1669f7","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b8622cb7f57cec67b1669f7: start","job_status":"start","queue_duration_s":0.924838,"scheduling_latency_s":0.924864}1393vm-test-run-nixbot-gitlab> gitlab # [  231.553691] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b8622cb7f57cec67b1669f7","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b8622cb7f57cec67b1669f7: done: 0.031752 sec","job_status":"done","queue_duration_s":0.924838,"scheduling_latency_s":0.924864,"redis_calls":16,"redis_duration_s":0.004353,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000622,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001296,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002435,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00039498,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.031752,"completed_at":"2026-06-17T14:56:06.381Z","load_balancing_strategy":"primary","db_duration_s":0.000758,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1394vm-test-run-nixbot-gitlab> gitlab # [  231.592968] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b0de238f8b5a039c3c8af22","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b0de238f8b5a039c3c8af22: start","job_status":"start","queue_duration_s":0.958538,"scheduling_latency_s":0.958567}1395vm-test-run-nixbot-gitlab> gitlab # [  231.604513] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.404Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b0de238f8b5a039c3c8af22","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b0de238f8b5a039c3c8af22: done: 0.021231 sec","job_status":"done","queue_duration_s":0.958538,"scheduling_latency_s":0.958567,"redis_calls":13,"redis_duration_s":0.003092,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00111,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012258,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021231,"completed_at":"2026-06-17T14:56:06.404Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396vm-test-run-nixbot-gitlab> gitlab # [  231.641227] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.406Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9c59206c4f40f49d3c73a1e","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9c59206c4f40f49d3c73a1e: start","job_status":"start","queue_duration_s":0.981559,"scheduling_latency_s":0.981589}1397vm-test-run-nixbot-gitlab> gitlab # [  231.652681] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.426Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b9c59206c4f40f49d3c73a1e","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b9c59206c4f40f49d3c73a1e: done: 0.019473 sec","job_status":"done","queue_duration_s":0.981559,"scheduling_latency_s":0.981589,"redis_calls":13,"redis_duration_s":0.002925,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00103,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019473,"completed_at":"2026-06-17T14:56:06.426Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398vm-test-run-nixbot-gitlab> gitlab # [  231.689570] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1e4141e2a3ce1aff96563b8","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1e4141e2a3ce1aff96563b8: start","job_status":"start","queue_duration_s":1.00265,"scheduling_latency_s":1.002675}1399vm-test-run-nixbot-gitlab> gitlab # [  231.701553] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.446Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e1e4141e2a3ce1aff96563b8","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e1e4141e2a3ce1aff96563b8: done: 0.018805 sec","job_status":"done","queue_duration_s":1.00265,"scheduling_latency_s":1.002675,"redis_calls":13,"redis_duration_s":0.0029100000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001069,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001841,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011912,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018805,"completed_at":"2026-06-17T14:56:06.446Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1400vm-test-run-nixbot-gitlab> gitlab # [  231.739002] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"034fddda2a575c8bbbd8086e","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-034fddda2a575c8bbbd8086e: start","job_status":"start","queue_duration_s":1.023159,"scheduling_latency_s":1.023185}1401vm-test-run-nixbot-gitlab> gitlab # [  231.751002] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"034fddda2a575c8bbbd8086e","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-034fddda2a575c8bbbd8086e: done: 0.019605 sec","job_status":"done","queue_duration_s":1.023159,"scheduling_latency_s":1.023185,"redis_calls":13,"redis_duration_s":0.002985,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019605,"completed_at":"2026-06-17T14:56:06.467Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1402vm-test-run-nixbot-gitlab> gitlab # [  231.789579] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f1c4b56c3acebfd65b10c81","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f1c4b56c3acebfd65b10c81: start","job_status":"start","queue_duration_s":1.045498,"scheduling_latency_s":1.045527}1403vm-test-run-nixbot-gitlab> gitlab # [  231.801056] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.490Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2f1c4b56c3acebfd65b10c81","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2f1c4b56c3acebfd65b10c81: done: 0.019738 sec","job_status":"done","queue_duration_s":1.045498,"scheduling_latency_s":1.045527,"redis_calls":13,"redis_duration_s":0.0030830000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00205,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012175,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019738,"completed_at":"2026-06-17T14:56:06.490Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1404vm-test-run-nixbot-gitlab> gitlab # [  231.837293] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.492Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d965b80777e2b79e4accedc1","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d965b80777e2b79e4accedc1: start","job_status":"start","queue_duration_s":1.066997,"scheduling_latency_s":1.067023}1405vm-test-run-nixbot-gitlab> gitlab # [  231.848776] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d965b80777e2b79e4accedc1","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d965b80777e2b79e4accedc1: done: 0.019576 sec","job_status":"done","queue_duration_s":1.066997,"scheduling_latency_s":1.067023,"redis_calls":13,"redis_duration_s":0.0030670000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019576,"completed_at":"2026-06-17T14:56:06.511Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1406vm-test-run-nixbot-gitlab> gitlab # [  231.887908] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0246534c65fc136a19ed20a8","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0246534c65fc136a19ed20a8: start","job_status":"start","queue_duration_s":1.088333,"scheduling_latency_s":1.088361}1407vm-test-run-nixbot-gitlab> gitlab # [  231.899721] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0246534c65fc136a19ed20a8","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0246534c65fc136a19ed20a8: done: 0.020037 sec","job_status":"done","queue_duration_s":1.088333,"scheduling_latency_s":1.088361,"redis_calls":13,"redis_duration_s":0.002887,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00123,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001657,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012898,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020037,"completed_at":"2026-06-17T14:56:06.533Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1408vm-test-run-nixbot-gitlab> gitlab # [  231.936075] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"343f4f8053e983c0cd788b0c","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-343f4f8053e983c0cd788b0c: start","job_status":"start","queue_duration_s":1.110281,"scheduling_latency_s":1.110305}1409vm-test-run-nixbot-gitlab> gitlab # [  231.947524] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"343f4f8053e983c0cd788b0c","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-343f4f8053e983c0cd788b0c: done: 0.018311 sec","job_status":"done","queue_duration_s":1.110281,"scheduling_latency_s":1.110305,"redis_calls":13,"redis_duration_s":0.002899,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000994,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018311,"completed_at":"2026-06-17T14:56:06.553Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1410vm-test-run-nixbot-gitlab> gitlab # [  231.985358] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.556Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1220fad5d0fe23cb91f2a184","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1220fad5d0fe23cb91f2a184: start","job_status":"start","queue_duration_s":1.131202,"scheduling_latency_s":1.131227}1411vm-test-run-nixbot-gitlab> gitlab # [  231.996968] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.575Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1220fad5d0fe23cb91f2a184","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1220fad5d0fe23cb91f2a184: done: 0.018797 sec","job_status":"done","queue_duration_s":1.131202,"scheduling_latency_s":1.131227,"redis_calls":13,"redis_duration_s":0.0029969999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001014,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001983,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018797,"completed_at":"2026-06-17T14:56:06.575Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1412vm-test-run-nixbot-gitlab> gitlab # [  232.033842] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.576Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3394b11468bc11a65ef4394","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3394b11468bc11a65ef4394: start","job_status":"start","queue_duration_s":1.151683,"scheduling_latency_s":1.151704}1413vm-test-run-nixbot-gitlab> gitlab # [  232.045498] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a3394b11468bc11a65ef4394","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a3394b11468bc11a65ef4394: done: 0.024789 sec","job_status":"done","queue_duration_s":1.151683,"scheduling_latency_s":1.151704,"redis_calls":13,"redis_duration_s":0.0030610000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001044,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002017,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012362,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024789,"completed_at":"2026-06-17T14:56:06.601Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1414vm-test-run-nixbot-gitlab> gitlab # [  232.082402] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"425915c2951c10ef3e40a951","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-425915c2951c10ef3e40a951: start","job_status":"start","queue_duration_s":1.178261,"scheduling_latency_s":1.178287}1415vm-test-run-nixbot-gitlab> gitlab # [  232.094134] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"425915c2951c10ef3e40a951","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-425915c2951c10ef3e40a951: done: 0.026616 sec","job_status":"done","queue_duration_s":1.178261,"scheduling_latency_s":1.178287,"redis_calls":13,"redis_duration_s":0.007037,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00475,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002287,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016753,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026616,"completed_at":"2026-06-17T14:56:06.630Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1416vm-test-run-nixbot-gitlab> gitlab # [  232.130863] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"337d52b81d5092b4068a6a00","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-337d52b81d5092b4068a6a00: start","job_status":"start","queue_duration_s":1.20684,"scheduling_latency_s":1.206867}1417vm-test-run-nixbot-gitlab> gitlab # [  232.142578] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"337d52b81d5092b4068a6a00","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-337d52b81d5092b4068a6a00: done: 0.021216 sec","job_status":"done","queue_duration_s":1.20684,"scheduling_latency_s":1.206867,"redis_calls":13,"redis_duration_s":0.003267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001134,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002133,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013721,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021216,"completed_at":"2026-06-17T14:56:06.653Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418vm-test-run-nixbot-gitlab> gitlab # [  232.183238] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fd0b9741de470726e67e894","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fd0b9741de470726e67e894: start","job_status":"start","queue_duration_s":1.229896,"scheduling_latency_s":1.229921}1419vm-test-run-nixbot-gitlab> gitlab # [  232.196256] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7fd0b9741de470726e67e894","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7fd0b9741de470726e67e894: done: 0.021607 sec","job_status":"done","queue_duration_s":1.229896,"scheduling_latency_s":1.229921,"redis_calls":13,"redis_duration_s":0.0033770000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001144,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002233,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021607,"completed_at":"2026-06-17T14:56:06.676Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1420vm-test-run-nixbot-gitlab> gitlab # [  232.233445] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.678Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2b2334a0b5d504a63078941","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2b2334a0b5d504a63078941: start","job_status":"start","queue_duration_s":1.253307,"scheduling_latency_s":1.253331}1421vm-test-run-nixbot-gitlab> gitlab # [  232.245060] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.698Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a2b2334a0b5d504a63078941","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a2b2334a0b5d504a63078941: done: 0.019492 sec","job_status":"done","queue_duration_s":1.253307,"scheduling_latency_s":1.253331,"redis_calls":13,"redis_duration_s":0.003248,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019492,"completed_at":"2026-06-17T14:56:06.697Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1422vm-test-run-nixbot-gitlab> gitlab # [  232.281242] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.699Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c19b6751e0a3ae09deef6d1e","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c19b6751e0a3ae09deef6d1e: start","job_status":"start","queue_duration_s":1.274485,"scheduling_latency_s":1.274507}1423vm-test-run-nixbot-gitlab> gitlab # [  232.292789] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c19b6751e0a3ae09deef6d1e","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c19b6751e0a3ae09deef6d1e: done: 0.019 sec","job_status":"done","queue_duration_s":1.274485,"scheduling_latency_s":1.274507,"redis_calls":13,"redis_duration_s":0.003035,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000953,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002082,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019,"completed_at":"2026-06-17T14:56:06.718Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424vm-test-run-nixbot-gitlab> gitlab # [  232.329128] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.720Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4446a65e5c0d87ca206dd08b","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4446a65e5c0d87ca206dd08b: start","job_status":"start","queue_duration_s":1.295156,"scheduling_latency_s":1.295177}1425vm-test-run-nixbot-gitlab> gitlab # [  232.340635] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4446a65e5c0d87ca206dd08b","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4446a65e5c0d87ca206dd08b: done: 0.019614 sec","job_status":"done","queue_duration_s":1.295156,"scheduling_latency_s":1.295177,"redis_calls":13,"redis_duration_s":0.00319,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001346,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001844,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019614,"completed_at":"2026-06-17T14:56:06.739Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426vm-test-run-nixbot-gitlab> gitlab # [  232.377160] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.743Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87aec352577e07898ea341a0","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87aec352577e07898ea341a0: start","job_status":"start","queue_duration_s":1.318351,"scheduling_latency_s":1.318374}1427vm-test-run-nixbot-gitlab> gitlab # [  232.389778] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"87aec352577e07898ea341a0","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-87aec352577e07898ea341a0: done: 0.019615 sec","job_status":"done","queue_duration_s":1.318351,"scheduling_latency_s":1.318374,"redis_calls":13,"redis_duration_s":0.0030819999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00105,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002032,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019615,"completed_at":"2026-06-17T14:56:06.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428vm-test-run-nixbot-gitlab> gitlab # [  232.426139] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"755bc0b441c8e0e0d108cab4","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-755bc0b441c8e0e0d108cab4: start","job_status":"start","queue_duration_s":1.339733,"scheduling_latency_s":1.339752}1429vm-test-run-nixbot-gitlab> gitlab # [  232.437702] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.805Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"755bc0b441c8e0e0d108cab4","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-755bc0b441c8e0e0d108cab4: done: 0.04009 sec","job_status":"done","queue_duration_s":1.339733,"scheduling_latency_s":1.339752,"redis_calls":13,"redis_duration_s":0.004512,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001967,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002545,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04009,"completed_at":"2026-06-17T14:56:06.805Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430vm-test-run-nixbot-gitlab> gitlab # [  232.474923] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c75fd3b2fc1671c34aa5327","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c75fd3b2fc1671c34aa5327: start","job_status":"start","queue_duration_s":1.383321,"scheduling_latency_s":1.383372}1431vm-test-run-nixbot-gitlab> gitlab # [  232.486767] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.849Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1c75fd3b2fc1671c34aa5327","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1c75fd3b2fc1671c34aa5327: done: 0.041065 sec","job_status":"done","queue_duration_s":1.383321,"scheduling_latency_s":1.383372,"redis_calls":13,"redis_duration_s":0.004189999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001169,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003021,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024055,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.041065,"completed_at":"2026-06-17T14:56:06.849Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432vm-test-run-nixbot-gitlab> gitlab # [  232.523887] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.852Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5f0bef49058f85d13d19b11","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5f0bef49058f85d13d19b11: start","job_status":"start","queue_duration_s":1.426772,"scheduling_latency_s":1.426808}1433vm-test-run-nixbot-gitlab> gitlab # [  232.536162] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f5f0bef49058f85d13d19b11","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f5f0bef49058f85d13d19b11: done: 0.035381 sec","job_status":"done","queue_duration_s":1.426772,"scheduling_latency_s":1.426808,"redis_calls":13,"redis_duration_s":0.005996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020229,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.035381,"completed_at":"2026-06-17T14:56:06.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434vm-test-run-nixbot-gitlab> gitlab # [  232.572918] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.889Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e92233d50af1b92d5828550","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e92233d50af1b92d5828550: start","job_status":"start","queue_duration_s":1.464639,"scheduling_latency_s":1.464674}1435vm-test-run-nixbot-gitlab> gitlab # [  232.584436] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e92233d50af1b92d5828550","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e92233d50af1b92d5828550: done: 0.028894 sec","job_status":"done","queue_duration_s":1.464639,"scheduling_latency_s":1.464674,"redis_calls":13,"redis_duration_s":0.0038720000000000004,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001312,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00256,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028894,"completed_at":"2026-06-17T14:56:06.918Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1436vm-test-run-nixbot-gitlab> gitlab # [  232.622884] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.923Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c09ea198fac92629a304c15","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c09ea198fac92629a304c15: start","job_status":"start","queue_duration_s":1.498006,"scheduling_latency_s":1.498041}1437vm-test-run-nixbot-gitlab> gitlab # [  232.635033] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.948Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c09ea198fac92629a304c15","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c09ea198fac92629a304c15: done: 0.025717 sec","job_status":"done","queue_duration_s":1.498006,"scheduling_latency_s":1.498041,"redis_calls":13,"redis_duration_s":0.005244,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002418,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002826,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016313,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025717,"completed_at":"2026-06-17T14:56:06.948Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438vm-test-run-nixbot-gitlab> gitlab # [  232.673046] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.951Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44b568a4c7a027138af0892b","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44b568a4c7a027138af0892b: start","job_status":"start","queue_duration_s":1.525698,"scheduling_latency_s":1.525727}1439vm-test-run-nixbot-gitlab> gitlab # [  232.685986] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"44b568a4c7a027138af0892b","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-44b568a4c7a027138af0892b: done: 0.022133 sec","job_status":"done","queue_duration_s":1.525698,"scheduling_latency_s":1.525727,"redis_calls":13,"redis_duration_s":0.003209,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001062,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002147,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014037,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022133,"completed_at":"2026-06-17T14:56:06.973Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440vm-test-run-nixbot-gitlab> gitlab # [  232.723243] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"944d7a30b578c2b7e7148d9f","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-944d7a30b578c2b7e7148d9f: start","job_status":"start","queue_duration_s":1.549568,"scheduling_latency_s":1.549597}1441vm-test-run-nixbot-gitlab> gitlab # [  232.735697] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"944d7a30b578c2b7e7148d9f","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-944d7a30b578c2b7e7148d9f: done: 0.021393 sec","job_status":"done","queue_duration_s":1.549568,"scheduling_latency_s":1.549597,"redis_calls":13,"redis_duration_s":0.0030670000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001043,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002024,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011571,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021393,"completed_at":"2026-06-17T14:56:06.996Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442vm-test-run-nixbot-gitlab> gitlab # [  232.776239] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:06.998Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b74eef4d98d18b45dda90fdd","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b74eef4d98d18b45dda90fdd: start","job_status":"start","queue_duration_s":1.572874,"scheduling_latency_s":1.572898}1443vm-test-run-nixbot-gitlab> gitlab # [  232.787856] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b74eef4d98d18b45dda90fdd","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b74eef4d98d18b45dda90fdd: done: 0.019915 sec","job_status":"done","queue_duration_s":1.572874,"scheduling_latency_s":1.572898,"redis_calls":13,"redis_duration_s":0.004032,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001025,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003007,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012731,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019915,"completed_at":"2026-06-17T14:56:07.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1444vm-test-run-nixbot-gitlab> gitlab # [  232.826368] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8847152fb51671c8aee87b55","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8847152fb51671c8aee87b55: start","job_status":"start","queue_duration_s":1.594681,"scheduling_latency_s":1.594706}1445vm-test-run-nixbot-gitlab> gitlab # [  232.838142] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.040Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8847152fb51671c8aee87b55","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8847152fb51671c8aee87b55: done: 0.020604 sec","job_status":"done","queue_duration_s":1.594681,"scheduling_latency_s":1.594706,"redis_calls":13,"redis_duration_s":0.0034000000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001459,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001941,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020604,"completed_at":"2026-06-17T14:56:07.040Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1446vm-test-run-nixbot-gitlab> gitlab # [  232.875074] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.043Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aee30314f2b7ba6b2720075","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aee30314f2b7ba6b2720075: start","job_status":"start","queue_duration_s":1.618155,"scheduling_latency_s":1.618182}1447vm-test-run-nixbot-gitlab> gitlab # [  232.886856] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7aee30314f2b7ba6b2720075","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7aee30314f2b7ba6b2720075: done: 0.018945 sec","job_status":"done","queue_duration_s":1.618155,"scheduling_latency_s":1.618182,"redis_calls":13,"redis_duration_s":0.002975,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018945,"completed_at":"2026-06-17T14:56:07.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1448vm-test-run-nixbot-gitlab> gitlab # [  232.923622] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.215Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26bb2a8075445d293a18df04","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26bb2a8075445d293a18df04: start","job_status":"start","queue_duration_s":1.789825,"scheduling_latency_s":1.789884}1449vm-test-run-nixbot-gitlab> gitlab # [  232.935536] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.260Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"26bb2a8075445d293a18df04","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-26bb2a8075445d293a18df04: done: 0.044985 sec","job_status":"done","queue_duration_s":1.789825,"scheduling_latency_s":1.789884,"redis_calls":13,"redis_duration_s":0.003962,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001224,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002738,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.044985,"completed_at":"2026-06-17T14:56:07.259Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1450vm-test-run-nixbot-gitlab> gitlab # [  232.972998] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.263Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0904d0aa883806cfc503e643","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0904d0aa883806cfc503e643: start","job_status":"start","queue_duration_s":1.838002,"scheduling_latency_s":1.838052}1451vm-test-run-nixbot-gitlab> gitlab # [  232.984650] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0904d0aa883806cfc503e643","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0904d0aa883806cfc503e643: done: 0.201668 sec","job_status":"done","queue_duration_s":1.838002,"scheduling_latency_s":1.838052,"redis_calls":13,"redis_duration_s":0.004276,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001757,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002519,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026509,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.201668,"completed_at":"2026-06-17T14:56:07.464Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1452vm-test-run-nixbot-gitlab> gitlab # [  233.023251] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5470c28ddcccd09a9ca5277","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5470c28ddcccd09a9ca5277: start","job_status":"start","queue_duration_s":2.044243,"scheduling_latency_s":2.044302}1453vm-test-run-nixbot-gitlab> gitlab # [  233.035323] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.512Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d5470c28ddcccd09a9ca5277","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d5470c28ddcccd09a9ca5277: done: 0.042679 sec","job_status":"done","queue_duration_s":2.044243,"scheduling_latency_s":2.044302,"redis_calls":13,"redis_duration_s":0.004886,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001749,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003137,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027543,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.042679,"completed_at":"2026-06-17T14:56:07.512Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1454vm-test-run-nixbot-gitlab> gitlab # [  233.073651] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.515Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efd05d353bb9b90cb6229f5e","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efd05d353bb9b90cb6229f5e: start","job_status":"start","queue_duration_s":2.089901,"scheduling_latency_s":2.08994}1455vm-test-run-nixbot-gitlab> gitlab # [  233.085824] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.547Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"efd05d353bb9b90cb6229f5e","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-efd05d353bb9b90cb6229f5e: done: 0.032558 sec","job_status":"done","queue_duration_s":2.089901,"scheduling_latency_s":2.08994,"redis_calls":13,"redis_duration_s":0.004121,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001706,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002415,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.020992,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.032558,"completed_at":"2026-06-17T14:56:07.547Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1456vm-test-run-nixbot-gitlab> gitlab # [  233.122614] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"998a1146bc21cbdc1c6db6ef","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-998a1146bc21cbdc1c6db6ef: start","job_status":"start","queue_duration_s":2.124758,"scheduling_latency_s":2.124785}1457vm-test-run-nixbot-gitlab> gitlab # [  233.134358] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.577Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"998a1146bc21cbdc1c6db6ef","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-998a1146bc21cbdc1c6db6ef: done: 0.027566 sec","job_status":"done","queue_duration_s":2.124758,"scheduling_latency_s":2.124785,"redis_calls":13,"redis_duration_s":0.003802,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001289,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002513,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018329,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027566,"completed_at":"2026-06-17T14:56:07.577Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1458vm-test-run-nixbot-gitlab> gitlab # [  233.171537] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edd40bfb8fe34c357ffe2a7f","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edd40bfb8fe34c357ffe2a7f: start","job_status":"start","queue_duration_s":2.154553,"scheduling_latency_s":2.154578}1459vm-test-run-nixbot-gitlab> gitlab # [  233.183402] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.602Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"edd40bfb8fe34c357ffe2a7f","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-edd40bfb8fe34c357ffe2a7f: done: 0.022384 sec","job_status":"done","queue_duration_s":2.154553,"scheduling_latency_s":2.154578,"redis_calls":13,"redis_duration_s":0.0031669999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014123,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022384,"completed_at":"2026-06-17T14:56:07.602Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1460vm-test-run-nixbot-gitlab> gitlab # [  233.221262] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.604Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bf00d64559a07f22ea6eeba","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bf00d64559a07f22ea6eeba: start","job_status":"start","queue_duration_s":2.179156,"scheduling_latency_s":2.179179}1461vm-test-run-nixbot-gitlab> gitlab # [  233.232774] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.625Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0bf00d64559a07f22ea6eeba","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0bf00d64559a07f22ea6eeba: done: 0.021388 sec","job_status":"done","queue_duration_s":2.179156,"scheduling_latency_s":2.179179,"redis_calls":13,"redis_duration_s":0.003259,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001124,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002135,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012797,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.021388,"completed_at":"2026-06-17T14:56:07.625Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1462vm-test-run-nixbot-gitlab> gitlab # [  233.269815] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66e8067eefb6db973ccf7ec1","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66e8067eefb6db973ccf7ec1: start","job_status":"start","queue_duration_s":2.202361,"scheduling_latency_s":2.202382}1463vm-test-run-nixbot-gitlab> gitlab # [  233.281282] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.646Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66e8067eefb6db973ccf7ec1","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66e8067eefb6db973ccf7ec1: done: 0.018843 sec","job_status":"done","queue_duration_s":2.202361,"scheduling_latency_s":2.202382,"redis_calls":13,"redis_duration_s":0.003479,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00198,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011389,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018843,"completed_at":"2026-06-17T14:56:07.646Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1464vm-test-run-nixbot-gitlab> gitlab # [  233.317400] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42e90b9afdff6556dafeabee","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42e90b9afdff6556dafeabee: start","job_status":"start","queue_duration_s":2.22302,"scheduling_latency_s":2.22304}1465vm-test-run-nixbot-gitlab> gitlab # [  233.328917] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.667Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"42e90b9afdff6556dafeabee","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-42e90b9afdff6556dafeabee: done: 0.019067 sec","job_status":"done","queue_duration_s":2.22302,"scheduling_latency_s":2.22304,"redis_calls":13,"redis_duration_s":0.0034809999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001407,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002074,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011931,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019067,"completed_at":"2026-06-17T14:56:07.667Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1466vm-test-run-nixbot-gitlab> gitlab # [  233.364897] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b5c57c2925219aa5332bf95","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b5c57c2925219aa5332bf95: start","job_status":"start","queue_duration_s":2.24528,"scheduling_latency_s":2.245311}1467vm-test-run-nixbot-gitlab> gitlab # [  233.376364] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9b5c57c2925219aa5332bf95","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9b5c57c2925219aa5332bf95: done: 0.04238 sec","job_status":"done","queue_duration_s":2.24528,"scheduling_latency_s":2.245311,"redis_calls":13,"redis_duration_s":0.004612,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001632,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00298,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.04238,"completed_at":"2026-06-17T14:56:07.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1468vm-test-run-nixbot-gitlab> gitlab # [  233.413035] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.716Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e015c9eabc79d52b1ab81c1d","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e015c9eabc79d52b1ab81c1d: start","job_status":"start","queue_duration_s":2.291351,"scheduling_latency_s":2.291402}1469vm-test-run-nixbot-gitlab> gitlab # [  233.425159] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.750Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e015c9eabc79d52b1ab81c1d","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e015c9eabc79d52b1ab81c1d: done: 0.03406 sec","job_status":"done","queue_duration_s":2.291351,"scheduling_latency_s":2.291402,"redis_calls":13,"redis_duration_s":0.003547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002016,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03406,"completed_at":"2026-06-17T14:56:07.750Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1470vm-test-run-nixbot-gitlab> gitlab # [  233.462527] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2799c196c6198a2b083e17fa","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2799c196c6198a2b083e17fa: start","job_status":"start","queue_duration_s":2.327597,"scheduling_latency_s":2.327634}1471vm-test-run-nixbot-gitlab> gitlab # [  233.474518] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.780Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2799c196c6198a2b083e17fa","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2799c196c6198a2b083e17fa: done: 0.027676 sec","job_status":"done","queue_duration_s":2.327597,"scheduling_latency_s":2.327634,"redis_calls":13,"redis_duration_s":0.0035510000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001233,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002318,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01954,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.027676,"completed_at":"2026-06-17T14:56:07.780Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1472vm-test-run-nixbot-gitlab> gitlab # [  233.512194] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.782Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53434e15aaa6d83bf5a8a1cd","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53434e15aaa6d83bf5a8a1cd: start","job_status":"start","queue_duration_s":2.357139,"scheduling_latency_s":2.357165}1473vm-test-run-nixbot-gitlab> gitlab # [  233.523747] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53434e15aaa6d83bf5a8a1cd","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53434e15aaa6d83bf5a8a1cd: done: 0.026011 sec","job_status":"done","queue_duration_s":2.357139,"scheduling_latency_s":2.357165,"redis_calls":13,"redis_duration_s":0.002551,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00155,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018058,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026011,"completed_at":"2026-06-17T14:56:07.808Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1474vm-test-run-nixbot-gitlab> gitlab # [  233.561219] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c51a872c6abc080c81805c5a","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c51a872c6abc080c81805c5a: start","job_status":"start","queue_duration_s":2.385293,"scheduling_latency_s":2.385323}1475vm-test-run-nixbot-gitlab> gitlab # [  233.573067] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.835Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c51a872c6abc080c81805c5a","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c51a872c6abc080c81805c5a: done: 0.025436 sec","job_status":"done","queue_duration_s":2.385293,"scheduling_latency_s":2.385323,"redis_calls":13,"redis_duration_s":0.002419,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001515,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025436,"completed_at":"2026-06-17T14:56:07.835Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476vm-test-run-nixbot-gitlab> gitlab # [  233.610187] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"556bb3926cead2d889919396","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-556bb3926cead2d889919396: start","job_status":"start","queue_duration_s":2.413062,"scheduling_latency_s":2.413091}1477vm-test-run-nixbot-gitlab> gitlab # [  233.622896] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.863Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"556bb3926cead2d889919396","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-556bb3926cead2d889919396: done: 0.025457 sec","job_status":"done","queue_duration_s":2.413062,"scheduling_latency_s":2.413091,"redis_calls":13,"redis_duration_s":0.002534,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001606,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.025457,"completed_at":"2026-06-17T14:56:07.863Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1478vm-test-run-nixbot-gitlab> gitlab # [  233.660073] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.865Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"133a9d81f103c9bcaa499bc4","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-133a9d81f103c9bcaa499bc4: start","job_status":"start","queue_duration_s":2.440483,"scheduling_latency_s":2.440511}1479vm-test-run-nixbot-gitlab> gitlab # [  233.671707] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"133a9d81f103c9bcaa499bc4","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-133a9d81f103c9bcaa499bc4: done: 0.026995 sec","job_status":"done","queue_duration_s":2.440483,"scheduling_latency_s":2.440511,"redis_calls":13,"redis_duration_s":0.003001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001097,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018046,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.026995,"completed_at":"2026-06-17T14:56:07.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1480vm-test-run-nixbot-gitlab> gitlab # [  233.708859] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"013d0b3811c4966c7ed8bc85","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-013d0b3811c4966c7ed8bc85: start","job_status":"start","queue_duration_s":2.469454,"scheduling_latency_s":2.469482}1481vm-test-run-nixbot-gitlab> gitlab # [  233.720511] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.918Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"013d0b3811c4966c7ed8bc85","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-013d0b3811c4966c7ed8bc85: done: 0.024141 sec","job_status":"done","queue_duration_s":2.469454,"scheduling_latency_s":2.469482,"redis_calls":13,"redis_duration_s":0.002218,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000843,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001375,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024141,"completed_at":"2026-06-17T14:56:07.918Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482vm-test-run-nixbot-gitlab> gitlab # [  233.757298] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.920Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce7d391e287aa6eba439f6b1","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce7d391e287aa6eba439f6b1: start","job_status":"start","queue_duration_s":2.495506,"scheduling_latency_s":2.495533}1483vm-test-run-nixbot-gitlab> gitlab # [  233.768976] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ce7d391e287aa6eba439f6b1","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ce7d391e287aa6eba439f6b1: done: 0.019156 sec","job_status":"done","queue_duration_s":2.495506,"scheduling_latency_s":2.495533,"redis_calls":13,"redis_duration_s":0.0016549999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011602,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019156,"completed_at":"2026-06-17T14:56:07.939Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1484vm-test-run-nixbot-gitlab> gitlab # [  233.806414] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c7776ca5ea8d51e7328ac10","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c7776ca5ea8d51e7328ac10: start","job_status":"start","queue_duration_s":2.518069,"scheduling_latency_s":2.518122}1485vm-test-run-nixbot-gitlab> gitlab # [  233.819267] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c7776ca5ea8d51e7328ac10","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c7776ca5ea8d51e7328ac10: done: 0.046371 sec","job_status":"done","queue_duration_s":2.518069,"scheduling_latency_s":2.518122,"redis_calls":13,"redis_duration_s":0.004765999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001493,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003273,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03276,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.046371,"completed_at":"2026-06-17T14:56:07.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1486vm-test-run-nixbot-gitlab> gitlab # [  233.856614] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:07.993Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b697c033f387f0f9ef1407d9","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b697c033f387f0f9ef1407d9: start","job_status":"start","queue_duration_s":2.568622,"scheduling_latency_s":2.568683}1487vm-test-run-nixbot-gitlab> gitlab # [  233.868318] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:08.031Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b697c033f387f0f9ef1407d9","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b697c033f387f0f9ef1407d9: done: 0.037456 sec","job_status":"done","queue_duration_s":2.568622,"scheduling_latency_s":2.568683,"redis_calls":13,"redis_duration_s":0.004714,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00172,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002994,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.037456,"completed_at":"2026-06-17T14:56:08.031Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1488vm-test-run-nixbot-gitlab> gitlab # [  233.904906] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:08.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"209329d5655cb11c7805e37b","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-209329d5655cb11c7805e37b: start","job_status":"start","queue_duration_s":2.608577,"scheduling_latency_s":2.608607}1489vm-test-run-nixbot-gitlab> gitlab # [  233.916418] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:08.061Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"209329d5655cb11c7805e37b","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-209329d5655cb11c7805e37b: done: 0.028157 sec","job_status":"done","queue_duration_s":2.608577,"scheduling_latency_s":2.608607,"redis_calls":13,"redis_duration_s":0.0036550000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001242,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002413,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028157,"completed_at":"2026-06-17T14:56:08.061Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1490vm-test-run-nixbot-gitlab> gitlab # [  233.953123] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:08.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccb5aefaf66921c2eff3dddf","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccb5aefaf66921c2eff3dddf: start","job_status":"start","queue_duration_s":2.638908,"scheduling_latency_s":2.638933}1491vm-test-run-nixbot-gitlab> gitlab # [  233.964788] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:56:08.086Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ccb5aefaf66921c2eff3dddf","created_at":"2026-06-17T14:56:05.338Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-35428b4e865a49f6","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"d531ef7083c0396aaa0fe22ab74b153a","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:56:05.425Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ccb5aefaf66921c2eff3dddf: done: 0.022785 sec","job_status":"done","queue_duration_s":2.638908,"scheduling_latency_s":2.638933,"redis_calls":13,"redis_duration_s":0.003137,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001042,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002095,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014493,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022785,"completed_at":"2026-06-17T14:56:08.086Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1492vm-test-run-nixbot-gitlab> gitlab # [  260.637241] setup-gitlab-start[3311]: W, [2026-06-17T14:56:35.567663 #3311]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1493vm-test-run-nixbot-gitlab> gitlab # [  287.687884] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:02.616Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"729df3cf3d89e9490ba1b73b","created_at":"2026-06-17T14:57:02.601Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba46055ded474d76c2a0a251fffd1c8e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.613Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-729df3cf3d89e9490ba1b73b: start","job_status":"start","queue_duration_s":0.003157,"scheduling_latency_s":0.003213}1494vm-test-run-nixbot-gitlab> gitlab # [  287.851338] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:02.782Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1495vm-test-run-nixbot-gitlab> gitlab # [  287.919088] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:02.849Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"729df3cf3d89e9490ba1b73b","created_at":"2026-06-17T14:57:02.601Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ba46055ded474d76c2a0a251fffd1c8e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.613Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-729df3cf3d89e9490ba1b73b: done: 0.233175 sec","job_status":"done","queue_duration_s":0.003157,"scheduling_latency_s":0.003213,"redis_calls":14,"redis_duration_s":0.04302,"redis_read_bytes":901,"redis_write_bytes":1290,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.035165,"redis_feature_flag_read_bytes":896,"redis_feature_flag_write_bytes":464,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007061,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000794,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040043,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.233175,"completed_at":"2026-06-17T14:57:02.849Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496vm-test-run-nixbot-gitlab> gitlab # [  288.009990] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:02.939Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b64515c21cd4907e9edf0c9b","created_at":"2026-06-17T14:57:02.662Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a9083382a88cea57e12a0c24ae3023c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.669Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b64515c21cd4907e9edf0c9b: start","job_status":"start","queue_duration_s":0.270272,"scheduling_latency_s":0.270323}1497vm-test-run-nixbot-gitlab> gitlab # [  288.141553] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.071Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"b64515c21cd4907e9edf0c9b","created_at":"2026-06-17T14:57:02.662Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9a9083382a88cea57e12a0c24ae3023c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.669Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-b64515c21cd4907e9edf0c9b: done: 0.132481 sec","job_status":"done","queue_duration_s":0.270272,"scheduling_latency_s":0.270323,"redis_calls":7,"redis_duration_s":0.047271,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.023845,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.023426,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.132481,"completed_at":"2026-06-17T14:57:03.071Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498vm-test-run-nixbot-gitlab> gitlab # [  288.228594] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.092Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0f758936351e571519424280","created_at":"2026-06-17T14:57:02.692Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b85d1bd7323d06892a5c1ce77374909","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-17T14:57:02.698Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0f758936351e571519424280: start","job_status":"start","queue_duration_s":0.393478,"scheduling_latency_s":0.393527}1499vm-test-run-nixbot-gitlab> gitlab # [  288.365436] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.295Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"0f758936351e571519424280","created_at":"2026-06-17T14:57:02.692Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b85d1bd7323d06892a5c1ce77374909","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-17T14:57:02.698Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-0f758936351e571519424280: done: 0.202998 sec","job_status":"done","queue_duration_s":0.393478,"scheduling_latency_s":0.393527,"redis_calls":7,"redis_duration_s":0.027684,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0249,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002784,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.025,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.025,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.07613,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.202998,"completed_at":"2026-06-17T14:57:03.295Z","load_balancing_strategy":"primary","db_duration_s":0.025201,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500vm-test-run-nixbot-gitlab> gitlab # [  288.441663] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.299Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e349a23860f5457639177967","created_at":"2026-06-17T14:57:02.706Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"300043763be2ee39ecab7f13b14024f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.717Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e349a23860f5457639177967: start","job_status":"start","queue_duration_s":0.582292,"scheduling_latency_s":0.582343}1501vm-test-run-nixbot-gitlab> gitlab # [  288.470319] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.400Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"e349a23860f5457639177967","created_at":"2026-06-17T14:57:02.706Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"300043763be2ee39ecab7f13b14024f2","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.717Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-e349a23860f5457639177967: done: 0.101163 sec","job_status":"done","queue_duration_s":0.582292,"scheduling_latency_s":0.582343,"redis_calls":10,"redis_duration_s":0.00455,"redis_read_bytes":135,"redis_write_bytes":1302,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000411,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":133,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002143,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001996,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.029,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.029,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.048303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00138662,"exclusive_lock_hold_duration_s":0.03051358,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.101163,"completed_at":"2026-06-17T14:57:03.400Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.030424,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502vm-test-run-nixbot-gitlab> gitlab # [  288.520980] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.404Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"739f9476f828ca7bff9b5405","created_at":"2026-06-17T14:57:02.744Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9adefeffd4966d4c4844afa9471d5c33","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.769Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-739f9476f828ca7bff9b5405: start","job_status":"start","queue_duration_s":0.635496,"scheduling_latency_s":0.635543}1503vm-test-run-nixbot-gitlab> gitlab # [  288.534867] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.456Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"739f9476f828ca7bff9b5405","created_at":"2026-06-17T14:57:02.744Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9adefeffd4966d4c4844afa9471d5c33","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.769Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-739f9476f828ca7bff9b5405: done: 0.052169 sec","job_status":"done","queue_duration_s":0.635496,"scheduling_latency_s":0.635543,"redis_calls":8,"redis_duration_s":0.003415,"redis_read_bytes":133,"redis_write_bytes":963,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000389,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":137,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002219,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.052169,"completed_at":"2026-06-17T14:57:03.456Z","load_balancing_strategy":"primary","db_duration_s":0.015877,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1504vm-test-run-nixbot-gitlab> gitlab # [  288.577490] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.459Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f164fa40d9d629a2c3540167","created_at":"2026-06-17T14:57:02.800Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e02f4ff936bdb51be55605d5780dff8f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.812Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f164fa40d9d629a2c3540167: start","job_status":"start","queue_duration_s":0.647699,"scheduling_latency_s":0.647743}1505vm-test-run-nixbot-gitlab> gitlab # [  288.910954] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.840Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"f164fa40d9d629a2c3540167","created_at":"2026-06-17T14:57:02.800Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e02f4ff936bdb51be55605d5780dff8f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.812Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-f164fa40d9d629a2c3540167: done: 0.381174 sec","job_status":"done","queue_duration_s":0.647699,"scheduling_latency_s":0.647743,"redis_calls":10,"redis_duration_s":0.0033309999999999998,"redis_read_bytes":135,"redis_write_bytes":1098,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000328,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001651,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001352,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":123,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":123,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.073,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":123,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":80,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.073,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.27676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00101436,"exclusive_lock_hold_duration_s":0.35322938,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.381174,"completed_at":"2026-06-17T14:57:03.840Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.127772,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1506vm-test-run-nixbot-gitlab> gitlab # [  289.007013] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.842Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bbab7c19578d91741f6905fb","created_at":"2026-06-17T14:57:02.846Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08bd6be465ae3b310a1edc728d869197","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.858Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bbab7c19578d91741f6905fb: start","job_status":"start","queue_duration_s":0.984747,"scheduling_latency_s":0.984769}1507vm-test-run-nixbot-gitlab> gitlab # [  289.026415] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.875Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"bbab7c19578d91741f6905fb","created_at":"2026-06-17T14:57:02.846Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"08bd6be465ae3b310a1edc728d869197","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.858Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-bbab7c19578d91741f6905fb: done: 0.032976 sec","job_status":"done","queue_duration_s":0.984747,"scheduling_latency_s":0.984769,"redis_calls":15,"redis_duration_s":0.004012,"redis_read_bytes":144,"redis_write_bytes":4143,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000255,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":117,"redis_queues_calls":2,"redis_queues_duration_s":0.000567,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002262,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021791,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032976,"completed_at":"2026-06-17T14:57:03.875Z","load_balancing_strategy":"primary","db_duration_s":0.004442,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1508vm-test-run-nixbot-gitlab> gitlab # [  289.071162] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.877Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"baeecbb4451cee5af3f4ae87","created_at":"2026-06-17T14:57:02.902Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c2af6d836dc7d267000870c97655d6e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-17T14:57:02.906Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-baeecbb4451cee5af3f4ae87: start","job_status":"start","queue_duration_s":0.970597,"scheduling_latency_s":0.970616}1509vm-test-run-nixbot-gitlab> gitlab # [  289.083717] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.886Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1510vm-test-run-nixbot-gitlab> gitlab # [  289.086951] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.891Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"baeecbb4451cee5af3f4ae87","created_at":"2026-06-17T14:57:02.902Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c2af6d836dc7d267000870c97655d6e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-17T14:57:02.906Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-baeecbb4451cee5af3f4ae87: done: 0.014234 sec","job_status":"done","queue_duration_s":0.970597,"scheduling_latency_s":0.970616,"redis_calls":8,"redis_duration_s":0.0018930000000000002,"redis_read_bytes":133,"redis_write_bytes":941,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000232,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":135,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001208,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000453,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008634,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014234,"completed_at":"2026-06-17T14:57:03.891Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511vm-test-run-nixbot-gitlab> gitlab # [  289.124934] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:03.893Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"86061a2d2fa7a45dfc9e6b5a","created_at":"2026-06-17T14:57:02.912Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edfee22f9b12c8f73ae1f5c1d1093fda","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.917Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-86061a2d2fa7a45dfc9e6b5a: start","job_status":"start","queue_duration_s":0.975928,"scheduling_latency_s":0.975945}1512vm-test-run-nixbot-gitlab> gitlab # [  289.260203] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.191Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"86061a2d2fa7a45dfc9e6b5a","created_at":"2026-06-17T14:57:02.912Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"edfee22f9b12c8f73ae1f5c1d1093fda","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.917Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-86061a2d2fa7a45dfc9e6b5a: done: 0.298118 sec","job_status":"done","queue_duration_s":0.975928,"scheduling_latency_s":0.975945,"redis_calls":572,"redis_duration_s":0.060265,"redis_read_bytes":697,"redis_write_bytes":49597,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000223,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001205,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.058837,"redis_shared_state_read_bytes":565,"redis_shared_state_write_bytes":49017,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.271141,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.298118,"completed_at":"2026-06-17T14:57:04.191Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513vm-test-run-nixbot-gitlab> gitlab # [  289.337186] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.192Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c0af31d49d25e444b972841d","created_at":"2026-06-17T14:57:02.926Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"686c182f9cad20cf852a02f64456a7ff","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.929Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c0af31d49d25e444b972841d: start","job_status":"start","queue_duration_s":1.263044,"scheduling_latency_s":1.263065}1514vm-test-run-nixbot-gitlab> gitlab # [  289.353037] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.213Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"c0af31d49d25e444b972841d","created_at":"2026-06-17T14:57:02.926Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"686c182f9cad20cf852a02f64456a7ff","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.929Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-c0af31d49d25e444b972841d: done: 0.020455 sec","job_status":"done","queue_duration_s":1.263044,"scheduling_latency_s":1.263065,"redis_calls":10,"redis_duration_s":0.003222,"redis_read_bytes":135,"redis_write_bytes":1211,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000719,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":124,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001247,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001256,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00059728,"exclusive_lock_hold_duration_s":0.00418082,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.020455,"completed_at":"2026-06-17T14:57:04.213Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002417,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515vm-test-run-nixbot-gitlab> gitlab # [  289.395265] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.214Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a87fe8f45d497b21b1f3eac5","created_at":"2026-06-17T14:57:02.938Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0876c6ffe9de3f40b6691080de741e67","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.944Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a87fe8f45d497b21b1f3eac5: start","job_status":"start","queue_duration_s":1.27009,"scheduling_latency_s":1.270106}1516vm-test-run-nixbot-gitlab> gitlab # [  289.408908] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.237Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"a87fe8f45d497b21b1f3eac5","created_at":"2026-06-17T14:57:02.938Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0876c6ffe9de3f40b6691080de741e67","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.944Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-a87fe8f45d497b21b1f3eac5: done: 0.022557 sec","job_status":"done","queue_duration_s":1.27009,"scheduling_latency_s":1.270106,"redis_calls":11,"redis_duration_s":0.0030369999999999998,"redis_read_bytes":136,"redis_write_bytes":1366,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000232,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":127,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001599,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001206,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00530378,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.022557,"completed_at":"2026-06-17T14:57:04.237Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003409,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1517vm-test-run-nixbot-gitlab> gitlab # [  289.449815] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.239Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8bacb49f3f457bb038cd8e9d","created_at":"2026-06-17T14:57:02.948Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.952Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8bacb49f3f457bb038cd8e9d: start","job_status":"start","queue_duration_s":1.286969,"scheduling_latency_s":1.286987}1518vm-test-run-nixbot-gitlab> gitlab # [  289.462308] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"8bacb49f3f457bb038cd8e9d","created_at":"2026-06-17T14:57:02.948Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.952Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-8bacb49f3f457bb038cd8e9d: done: 0.090245 sec","job_status":"done","queue_duration_s":1.286969,"scheduling_latency_s":1.286987,"redis_calls":61,"redis_duration_s":0.015257,"redis_read_bytes":236,"redis_write_bytes":41233,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000251,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":124,"redis_queues_calls":2,"redis_queues_duration_s":0.000891,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.0134,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000715,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075693,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.090245,"completed_at":"2026-06-17T14:57:04.329Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519vm-test-run-nixbot-gitlab> gitlab # [  289.501725] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.330Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"8410c9e7b78317f5bc0a7095","created_at":"2026-06-17T14:57:02.956Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d11577e2f8523054d75841dcaf34f3f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.959Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-8410c9e7b78317f5bc0a7095: start","job_status":"start","queue_duration_s":1.371393,"scheduling_latency_s":1.371409}1520vm-test-run-nixbot-gitlab> gitlab # [  289.514975] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.346Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"8410c9e7b78317f5bc0a7095","created_at":"2026-06-17T14:57:02.956Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d11577e2f8523054d75841dcaf34f3f5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.959Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-8410c9e7b78317f5bc0a7095: done: 0.015082 sec","job_status":"done","queue_duration_s":1.371393,"scheduling_latency_s":1.371409,"redis_calls":10,"redis_duration_s":0.00232,"redis_read_bytes":389,"redis_write_bytes":1041,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000661,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":265,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0012,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000459,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009427,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015082,"completed_at":"2026-06-17T14:57:04.345Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521vm-test-run-nixbot-gitlab> gitlab # [  289.553794] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.347Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"41e03a791dc89d4aa626e9e6","created_at":"2026-06-17T14:57:02.966Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15b9972dc7150b343289a75b047aa1ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.969Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-41e03a791dc89d4aa626e9e6: start","job_status":"start","queue_duration_s":1.378253,"scheduling_latency_s":1.378268}1522vm-test-run-nixbot-gitlab> gitlab # [  289.567199] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.355Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1523vm-test-run-nixbot-gitlab> gitlab # [  289.570628] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.360Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"41e03a791dc89d4aa626e9e6","created_at":"2026-06-17T14:57:02.966Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"15b9972dc7150b343289a75b047aa1ed","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:02.969Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-41e03a791dc89d4aa626e9e6: done: 0.013234 sec","job_status":"done","queue_duration_s":1.378253,"scheduling_latency_s":1.378268,"redis_calls":8,"redis_duration_s":0.0018390000000000001,"redis_read_bytes":133,"redis_write_bytes":894,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":128,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001159,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000451,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013234,"completed_at":"2026-06-17T14:57:04.360Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524vm-test-run-nixbot-gitlab> gitlab # [  289.610531] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.362Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"10c57f320b6682256fab9a8c","created_at":"2026-06-17T14:57:02.980Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe436b5d6572972f5c5ca855653bdd4f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-17T14:57:02.982Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-10c57f320b6682256fab9a8c: start","job_status":"start","queue_duration_s":1.379252,"scheduling_latency_s":1.379268}1525vm-test-run-nixbot-gitlab> gitlab # [  289.623037] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.370Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1526vm-test-run-nixbot-gitlab> gitlab # [  289.626545] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.375Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"10c57f320b6682256fab9a8c","created_at":"2026-06-17T14:57:02.980Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"fe436b5d6572972f5c5ca855653bdd4f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-17T14:57:02.982Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-10c57f320b6682256fab9a8c: done: 0.013398 sec","job_status":"done","queue_duration_s":1.379252,"scheduling_latency_s":1.379268,"redis_calls":8,"redis_duration_s":0.001879,"redis_read_bytes":133,"redis_write_bytes":935,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":134,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001201,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000449,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008204,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013398,"completed_at":"2026-06-17T14:57:04.375Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527vm-test-run-nixbot-gitlab> gitlab # [  289.664669] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.376Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"57a59502e913c0712a65475e","created_at":"2026-06-17T14:57:03.018Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cad5904a0c3870f83fe1e51727e46d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.025Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-57a59502e913c0712a65475e: start","job_status":"start","queue_duration_s":1.351333,"scheduling_latency_s":1.351349}1528vm-test-run-nixbot-gitlab> gitlab # [  289.677928] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.384Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1529vm-test-run-nixbot-gitlab> gitlab # [  289.680846] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.390Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"57a59502e913c0712a65475e","created_at":"2026-06-17T14:57:03.018Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9cad5904a0c3870f83fe1e51727e46d3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.025Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-57a59502e913c0712a65475e: done: 0.013093 sec","job_status":"done","queue_duration_s":1.351333,"scheduling_latency_s":1.351349,"redis_calls":8,"redis_duration_s":0.0018189999999999999,"redis_read_bytes":133,"redis_write_bytes":900,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000227,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":129,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001148,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000444,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013093,"completed_at":"2026-06-17T14:57:04.389Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1530vm-test-run-nixbot-gitlab> gitlab # [  289.720748] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.391Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8a25008ca3cedd1b5c8be0cf","created_at":"2026-06-17T14:57:03.062Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a9b6ced45bd21da140ad9f03db787cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.067Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8a25008ca3cedd1b5c8be0cf: start","job_status":"start","queue_duration_s":1.323947,"scheduling_latency_s":1.323962}1531vm-test-run-nixbot-gitlab> gitlab # [  289.734463] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.399Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1532vm-test-run-nixbot-gitlab> gitlab # [  289.738066] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.405Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"8a25008ca3cedd1b5c8be0cf","created_at":"2026-06-17T14:57:03.062Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7a9b6ced45bd21da140ad9f03db787cc","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.067Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-8a25008ca3cedd1b5c8be0cf: done: 0.013873 sec","job_status":"done","queue_duration_s":1.323947,"scheduling_latency_s":1.323962,"redis_calls":8,"redis_duration_s":0.002404,"redis_read_bytes":133,"redis_write_bytes":958,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000245,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":137,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001686,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000473,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013873,"completed_at":"2026-06-17T14:57:04.405Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533vm-test-run-nixbot-gitlab> gitlab # [  289.777901] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.406Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"58a0f22b9da5fdef9745e7bf","created_at":"2026-06-17T14:57:03.090Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae94f391829f067ec844993eac6c0b80","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.097Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-58a0f22b9da5fdef9745e7bf: start","job_status":"start","queue_duration_s":1.309316,"scheduling_latency_s":1.309332}1534vm-test-run-nixbot-gitlab> gitlab # [  289.792585] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.445Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"58a0f22b9da5fdef9745e7bf","created_at":"2026-06-17T14:57:03.090Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ae94f391829f067ec844993eac6c0b80","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.097Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-58a0f22b9da5fdef9745e7bf: done: 0.038405 sec","job_status":"done","queue_duration_s":1.309316,"scheduling_latency_s":1.309332,"redis_calls":10,"redis_duration_s":0.002704,"redis_read_bytes":135,"redis_write_bytes":1294,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000257,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":132,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001255,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001192,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02065,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006072,"exclusive_lock_hold_duration_s":0.02323274,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.038405,"completed_at":"2026-06-17T14:57:04.445Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.013187,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535vm-test-run-nixbot-gitlab> gitlab # [  289.834257] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.446Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8a15b1165f1265541447ff26","created_at":"2026-06-17T14:57:03.158Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd8d71c5ef795c8d317c8eb6877c38f7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.163Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8a15b1165f1265541447ff26: start","job_status":"start","queue_duration_s":1.283196,"scheduling_latency_s":1.283212}1536vm-test-run-nixbot-gitlab> gitlab # [  289.847651] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.470Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"8a15b1165f1265541447ff26","created_at":"2026-06-17T14:57:03.158Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cd8d71c5ef795c8d317c8eb6877c38f7","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.163Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-8a15b1165f1265541447ff26: done: 0.023645 sec","job_status":"done","queue_duration_s":1.283196,"scheduling_latency_s":1.283212,"redis_calls":8,"redis_duration_s":0.002122,"redis_read_bytes":133,"redis_write_bytes":827,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000254,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":116,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001384,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000484,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011704,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.023645,"completed_at":"2026-06-17T14:57:04.470Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006881,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537vm-test-run-nixbot-gitlab> gitlab # [  289.886972] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.471Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"558d5a152a7e2a82ac1d6066","created_at":"2026-06-17T14:57:03.210Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f084bdf1c18a02fa17aaa09014df1f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.220Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-558d5a152a7e2a82ac1d6066: start","job_status":"start","queue_duration_s":1.251405,"scheduling_latency_s":1.251422}1538vm-test-run-nixbot-gitlab> gitlab # [  289.903276] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.489Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"558d5a152a7e2a82ac1d6066","created_at":"2026-06-17T14:57:03.210Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3f084bdf1c18a02fa17aaa09014df1f8","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.220Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-558d5a152a7e2a82ac1d6066: done: 0.017525 sec","job_status":"done","queue_duration_s":1.251405,"scheduling_latency_s":1.251422,"redis_calls":10,"redis_duration_s":0.002539,"redis_read_bytes":135,"redis_write_bytes":1194,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000226,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":122,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001189,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001124,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00052928,"exclusive_lock_hold_duration_s":0.00339146,"duration_s":0.017525,"completed_at":"2026-06-17T14:57:04.489Z","load_balancing_strategy":"primary","db_duration_s":0.001679,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539vm-test-run-nixbot-gitlab> gitlab # [  289.942788] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.490Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9b754f40f05ecd2214ef5dd8","created_at":"2026-06-17T14:57:03.279Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a09d68f289c0a51a36fbabe843297103","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.290Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9b754f40f05ecd2214ef5dd8: start","job_status":"start","queue_duration_s":1.200071,"scheduling_latency_s":1.200088}1540vm-test-run-nixbot-gitlab> gitlab # [  289.955944] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.506Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"9b754f40f05ecd2214ef5dd8","created_at":"2026-06-17T14:57:03.279Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-96ca09e7c432469f","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a09d68f289c0a51a36fbabe843297103","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.290Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-9b754f40f05ecd2214ef5dd8: done: 0.015832 sec","job_status":"done","queue_duration_s":1.200071,"scheduling_latency_s":1.200088,"redis_calls":8,"redis_duration_s":0.002031,"redis_read_bytes":133,"redis_write_bytes":791,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000247,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001314,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00047,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015832,"completed_at":"2026-06-17T14:57:04.506Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001329,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541vm-test-run-nixbot-gitlab> gitlab # [  289.996162] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.508Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"753b8ffa7284477124569c4d","created_at":"2026-06-17T14:57:03.859Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-cf0734fcdd0a4bef","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"08bd6be465ae3b310a1edc728d869197","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.869Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-753b8ffa7284477124569c4d: start","job_status":"start","queue_duration_s":0.638441,"scheduling_latency_s":0.638457}1542vm-test-run-nixbot-gitlab> gitlab # [  290.007667] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.519Z","message":"No existing merge request to be cleaned up."}1543vm-test-run-nixbot-gitlab> gitlab # [  290.009334] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.528Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"753b8ffa7284477124569c4d","created_at":"2026-06-17T14:57:03.859Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-cf0734fcdd0a4bef","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"08bd6be465ae3b310a1edc728d869197","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.869Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-753b8ffa7284477124569c4d: done: 0.019942 sec","job_status":"done","queue_duration_s":0.638441,"scheduling_latency_s":0.638457,"redis_calls":10,"redis_duration_s":0.00262,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001526,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011987,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019942,"completed_at":"2026-06-17T14:57:04.527Z","load_balancing_strategy":"primary","db_duration_s":0.003071,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1544vm-test-run-nixbot-gitlab> gitlab # [  290.046007] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.529Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0cda8e730502b6a4ad4731f9","created_at":"2026-06-17T14:57:03.859Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-cf0734fcdd0a4bef","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"08bd6be465ae3b310a1edc728d869197","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.869Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0cda8e730502b6a4ad4731f9: start","job_status":"start","queue_duration_s":0.659774,"scheduling_latency_s":0.65979}1545vm-test-run-nixbot-gitlab> gitlab # [  290.057604] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.539Z","message":"No existing merge request to be cleaned up."}1546vm-test-run-nixbot-gitlab> gitlab # [  290.059179] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.548Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0cda8e730502b6a4ad4731f9","created_at":"2026-06-17T14:57:03.859Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-cf0734fcdd0a4bef","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"08bd6be465ae3b310a1edc728d869197","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.869Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0cda8e730502b6a4ad4731f9: done: 0.019224 sec","job_status":"done","queue_duration_s":0.659774,"scheduling_latency_s":0.65979,"redis_calls":10,"redis_duration_s":0.002666,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001112,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001554,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011857,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019224,"completed_at":"2026-06-17T14:57:04.548Z","load_balancing_strategy":"primary","db_duration_s":0.002529,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547vm-test-run-nixbot-gitlab> gitlab # [  290.096028] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.550Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8ffe53a430eb3e45372a9abb","created_at":"2026-06-17T14:57:03.859Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-cf0734fcdd0a4bef","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"08bd6be465ae3b310a1edc728d869197","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.869Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8ffe53a430eb3e45372a9abb: start","job_status":"start","queue_duration_s":0.680472,"scheduling_latency_s":0.680487}1548vm-test-run-nixbot-gitlab> gitlab # [  290.107324] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.560Z","message":"No existing merge request to be cleaned up."}1549vm-test-run-nixbot-gitlab> gitlab # [  290.109042] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.568Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"8ffe53a430eb3e45372a9abb","created_at":"2026-06-17T14:57:03.859Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-cf0734fcdd0a4bef","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"08bd6be465ae3b310a1edc728d869197","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.869Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-8ffe53a430eb3e45372a9abb: done: 0.018658 sec","job_status":"done","queue_duration_s":0.680472,"scheduling_latency_s":0.680487,"redis_calls":10,"redis_duration_s":0.002471,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00144,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011536,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018658,"completed_at":"2026-06-17T14:57:04.568Z","load_balancing_strategy":"primary","db_duration_s":0.002483,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550vm-test-run-nixbot-gitlab> gitlab # [  290.145557] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.570Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a9bbbdd5f0d56d3073e7f251","created_at":"2026-06-17T14:57:03.859Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-cf0734fcdd0a4bef","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"08bd6be465ae3b310a1edc728d869197","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.869Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a9bbbdd5f0d56d3073e7f251: start","job_status":"start","queue_duration_s":0.700497,"scheduling_latency_s":0.700512}1551vm-test-run-nixbot-gitlab> gitlab # [  290.157312] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.580Z","message":"No existing merge request to be cleaned up."}1552vm-test-run-nixbot-gitlab> gitlab # [  290.158879] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.588Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a9bbbdd5f0d56d3073e7f251","created_at":"2026-06-17T14:57:03.859Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-cf0734fcdd0a4bef","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"08bd6be465ae3b310a1edc728d869197","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:03.869Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a9bbbdd5f0d56d3073e7f251: done: 0.018766 sec","job_status":"done","queue_duration_s":0.700497,"scheduling_latency_s":0.700512,"redis_calls":10,"redis_duration_s":0.002493,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001438,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018766,"completed_at":"2026-06-17T14:57:04.588Z","load_balancing_strategy":"primary","db_duration_s":0.002477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1553vm-test-run-nixbot-gitlab> gitlab # [  290.195354] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.590Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4825dea391bdd69821d87d30","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4825dea391bdd69821d87d30: start","job_status":"start","queue_duration_s":0.268774,"scheduling_latency_s":0.268789}1554vm-test-run-nixbot-gitlab> gitlab # [  290.208393] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.606Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4825dea391bdd69821d87d30","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4825dea391bdd69821d87d30: done: 0.015791 sec","job_status":"done","queue_duration_s":0.268774,"scheduling_latency_s":0.268789,"redis_calls":13,"redis_duration_s":0.003277,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001006,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002271,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009436,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015791,"completed_at":"2026-06-17T14:57:04.606Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555vm-test-run-nixbot-gitlab> gitlab # [  290.245360] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.607Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b023ee5c2fb29295c134e3b","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b023ee5c2fb29295c134e3b: start","job_status":"start","queue_duration_s":0.285942,"scheduling_latency_s":0.285957}1556vm-test-run-nixbot-gitlab> gitlab # [  290.257555] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.622Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b023ee5c2fb29295c134e3b","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b023ee5c2fb29295c134e3b: done: 0.015059 sec","job_status":"done","queue_duration_s":0.285942,"scheduling_latency_s":0.285957,"redis_calls":13,"redis_duration_s":0.002745,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000931,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001814,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015059,"completed_at":"2026-06-17T14:57:04.622Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1557vm-test-run-nixbot-gitlab> gitlab # [  290.294263] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"012d327cd7ee2c6e623ada1d","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-012d327cd7ee2c6e623ada1d: start","job_status":"start","queue_duration_s":0.302272,"scheduling_latency_s":0.302288}1558vm-test-run-nixbot-gitlab> gitlab # [  290.306113] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.638Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"012d327cd7ee2c6e623ada1d","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-012d327cd7ee2c6e623ada1d: done: 0.014786 sec","job_status":"done","queue_duration_s":0.302272,"scheduling_latency_s":0.302288,"redis_calls":13,"redis_duration_s":0.002565,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000913,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001652,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014786,"completed_at":"2026-06-17T14:57:04.638Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1559vm-test-run-nixbot-gitlab> gitlab # [  290.343084] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.639Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34e9216273b64dd351addc78","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34e9216273b64dd351addc78: start","job_status":"start","queue_duration_s":0.318329,"scheduling_latency_s":0.318344}1560vm-test-run-nixbot-gitlab> gitlab # [  290.354938] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.654Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34e9216273b64dd351addc78","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34e9216273b64dd351addc78: done: 0.014677 sec","job_status":"done","queue_duration_s":0.318329,"scheduling_latency_s":0.318344,"redis_calls":13,"redis_duration_s":0.0025599999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009146,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014677,"completed_at":"2026-06-17T14:57:04.654Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561vm-test-run-nixbot-gitlab> gitlab # [  290.391871] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.655Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e998b309502849755267a50","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e998b309502849755267a50: start","job_status":"start","queue_duration_s":0.334281,"scheduling_latency_s":0.334295}1562vm-test-run-nixbot-gitlab> gitlab # [  290.404708] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6e998b309502849755267a50","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6e998b309502849755267a50: done: 0.015058 sec","job_status":"done","queue_duration_s":0.334281,"scheduling_latency_s":0.334295,"redis_calls":13,"redis_duration_s":0.002761,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001815,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015058,"completed_at":"2026-06-17T14:57:04.670Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563vm-test-run-nixbot-gitlab> gitlab # [  290.441528] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.672Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8df0fe0e7859c9c08a83418","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8df0fe0e7859c9c08a83418: start","job_status":"start","queue_duration_s":0.350776,"scheduling_latency_s":0.350791}1564vm-test-run-nixbot-gitlab> gitlab # [  290.453135] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d8df0fe0e7859c9c08a83418","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d8df0fe0e7859c9c08a83418: done: 0.014745 sec","job_status":"done","queue_duration_s":0.350776,"scheduling_latency_s":0.350791,"redis_calls":13,"redis_duration_s":0.002615,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001709,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014745,"completed_at":"2026-06-17T14:57:04.686Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565vm-test-run-nixbot-gitlab> gitlab # [  290.489811] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.688Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89dd7786c00c62416d7b9df6","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89dd7786c00c62416d7b9df6: start","job_status":"start","queue_duration_s":0.366777,"scheduling_latency_s":0.366791}1566vm-test-run-nixbot-gitlab> gitlab # [  290.501567] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"89dd7786c00c62416d7b9df6","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-89dd7786c00c62416d7b9df6: done: 0.014722 sec","job_status":"done","queue_duration_s":0.366777,"scheduling_latency_s":0.366791,"redis_calls":13,"redis_duration_s":0.002633,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009139,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014722,"completed_at":"2026-06-17T14:57:04.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567vm-test-run-nixbot-gitlab> gitlab # [  290.538384] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.704Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e79124608f73c64c05138a95","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e79124608f73c64c05138a95: start","job_status":"start","queue_duration_s":0.383371,"scheduling_latency_s":0.383387}1568vm-test-run-nixbot-gitlab> gitlab # [  290.550152] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e79124608f73c64c05138a95","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e79124608f73c64c05138a95: done: 0.015091 sec","job_status":"done","queue_duration_s":0.383371,"scheduling_latency_s":0.383387,"redis_calls":13,"redis_duration_s":0.002758,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00096,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001798,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009257,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015091,"completed_at":"2026-06-17T14:57:04.719Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569vm-test-run-nixbot-gitlab> gitlab # [  290.587118] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5254572ef9b26f9af760f9b0","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5254572ef9b26f9af760f9b0: start","job_status":"start","queue_duration_s":0.399798,"scheduling_latency_s":0.399812}1570vm-test-run-nixbot-gitlab> gitlab # [  290.598940] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.735Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5254572ef9b26f9af760f9b0","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5254572ef9b26f9af760f9b0: done: 0.014649 sec","job_status":"done","queue_duration_s":0.399798,"scheduling_latency_s":0.399812,"redis_calls":13,"redis_duration_s":0.002634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001728,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014649,"completed_at":"2026-06-17T14:57:04.735Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571vm-test-run-nixbot-gitlab> gitlab # [  290.636575] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b9338c4effa0fc9c2add7cd","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b9338c4effa0fc9c2add7cd: start","job_status":"start","queue_duration_s":0.415801,"scheduling_latency_s":0.415816}1572vm-test-run-nixbot-gitlab> gitlab # [  290.648139] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.751Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b9338c4effa0fc9c2add7cd","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b9338c4effa0fc9c2add7cd: done: 0.014669 sec","job_status":"done","queue_duration_s":0.415801,"scheduling_latency_s":0.415816,"redis_calls":13,"redis_duration_s":0.002633,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00907,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014669,"completed_at":"2026-06-17T14:57:04.751Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573vm-test-run-nixbot-gitlab> gitlab # [  290.684664] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.753Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f98b3e9f60bf2734abade599","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f98b3e9f60bf2734abade599: start","job_status":"start","queue_duration_s":0.431789,"scheduling_latency_s":0.431804}1574vm-test-run-nixbot-gitlab> gitlab # [  290.696173] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f98b3e9f60bf2734abade599","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f98b3e9f60bf2734abade599: done: 0.014994 sec","job_status":"done","queue_duration_s":0.431789,"scheduling_latency_s":0.431804,"redis_calls":13,"redis_duration_s":0.002698,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000958,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00174,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009277,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014994,"completed_at":"2026-06-17T14:57:04.768Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575vm-test-run-nixbot-gitlab> gitlab # [  290.732649] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.769Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6d3e9309e6e9b8bc008193d","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6d3e9309e6e9b8bc008193d: start","job_status":"start","queue_duration_s":0.448177,"scheduling_latency_s":0.448193}1576vm-test-run-nixbot-gitlab> gitlab # [  290.744250] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.784Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6d3e9309e6e9b8bc008193d","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6d3e9309e6e9b8bc008193d: done: 0.014915 sec","job_status":"done","queue_duration_s":0.448177,"scheduling_latency_s":0.448193,"redis_calls":13,"redis_duration_s":0.002749,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000947,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001802,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009144,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014915,"completed_at":"2026-06-17T14:57:04.784Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577vm-test-run-nixbot-gitlab> gitlab # [  290.780788] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae04fe62652fbfc216f6ee1c","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae04fe62652fbfc216f6ee1c: start","job_status":"start","queue_duration_s":0.464429,"scheduling_latency_s":0.464444}1578vm-test-run-nixbot-gitlab> gitlab # [  290.792186] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae04fe62652fbfc216f6ee1c","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae04fe62652fbfc216f6ee1c: done: 0.014639 sec","job_status":"done","queue_duration_s":0.464429,"scheduling_latency_s":0.464444,"redis_calls":13,"redis_duration_s":0.002667,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001751,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014639,"completed_at":"2026-06-17T14:57:04.800Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579vm-test-run-nixbot-gitlab> gitlab # [  290.829765] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.801Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"103d5b3694b3d697fecc8f0a","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-103d5b3694b3d697fecc8f0a: start","job_status":"start","queue_duration_s":0.480399,"scheduling_latency_s":0.480415}1580vm-test-run-nixbot-gitlab> gitlab # [  290.841514] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.816Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"103d5b3694b3d697fecc8f0a","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-103d5b3694b3d697fecc8f0a: done: 0.014878 sec","job_status":"done","queue_duration_s":0.480399,"scheduling_latency_s":0.480415,"redis_calls":13,"redis_duration_s":0.002517,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000807,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00171,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00938,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014878,"completed_at":"2026-06-17T14:57:04.816Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581vm-test-run-nixbot-gitlab> gitlab # [  290.878276] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4661a959ea49f22f5948b72","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4661a959ea49f22f5948b72: start","job_status":"start","queue_duration_s":0.499042,"scheduling_latency_s":0.49906}1582vm-test-run-nixbot-gitlab> gitlab # [  290.889803] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a4661a959ea49f22f5948b72","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a4661a959ea49f22f5948b72: done: 0.034853 sec","job_status":"done","queue_duration_s":0.499042,"scheduling_latency_s":0.49906,"redis_calls":13,"redis_duration_s":0.00536,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.002349,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003011,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034853,"completed_at":"2026-06-17T14:57:04.855Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583vm-test-run-nixbot-gitlab> gitlab # [  290.926688] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3831ba6acb90919aa6df22c9","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3831ba6acb90919aa6df22c9: start","job_status":"start","queue_duration_s":0.537056,"scheduling_latency_s":0.537096}1584vm-test-run-nixbot-gitlab> gitlab # [  290.938469] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3831ba6acb90919aa6df22c9","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3831ba6acb90919aa6df22c9: done: 0.028083 sec","job_status":"done","queue_duration_s":0.537056,"scheduling_latency_s":0.537096,"redis_calls":13,"redis_duration_s":0.002626,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028083,"completed_at":"2026-06-17T14:57:04.886Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585vm-test-run-nixbot-gitlab> gitlab # [  290.976085] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21152c0e434ea935d3349cf3","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21152c0e434ea935d3349cf3: start","job_status":"start","queue_duration_s":0.56686,"scheduling_latency_s":0.566883}1586vm-test-run-nixbot-gitlab> gitlab # [  290.987706] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.909Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21152c0e434ea935d3349cf3","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21152c0e434ea935d3349cf3: done: 0.02084 sec","job_status":"done","queue_duration_s":0.56686,"scheduling_latency_s":0.566883,"redis_calls":13,"redis_duration_s":0.002321,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001017,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001304,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02084,"completed_at":"2026-06-17T14:57:04.909Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587vm-test-run-nixbot-gitlab> gitlab # [  291.025595] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.910Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"429dd722c2fab6db4268bb57","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-429dd722c2fab6db4268bb57: start","job_status":"start","queue_duration_s":0.589093,"scheduling_latency_s":0.589113}1588vm-test-run-nixbot-gitlab> gitlab # [  291.037292] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.927Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"429dd722c2fab6db4268bb57","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-429dd722c2fab6db4268bb57: done: 0.016763 sec","job_status":"done","queue_duration_s":0.589093,"scheduling_latency_s":0.589113,"redis_calls":13,"redis_duration_s":0.00165,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000591,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001059,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016763,"completed_at":"2026-06-17T14:57:04.927Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589vm-test-run-nixbot-gitlab> gitlab # [  291.074028] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.928Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ce237958a84398ab6f4553e","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ce237958a84398ab6f4553e: start","job_status":"start","queue_duration_s":0.607064,"scheduling_latency_s":0.607081}1590vm-test-run-nixbot-gitlab> gitlab # [  291.085686] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.943Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7ce237958a84398ab6f4553e","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7ce237958a84398ab6f4553e: done: 0.015113 sec","job_status":"done","queue_duration_s":0.607064,"scheduling_latency_s":0.607081,"redis_calls":13,"redis_duration_s":0.0015049999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000551,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010386,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015113,"completed_at":"2026-06-17T14:57:04.943Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591vm-test-run-nixbot-gitlab> gitlab # [  291.122471] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.944Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93bf9944437cce423df0e635","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93bf9944437cce423df0e635: start","job_status":"start","queue_duration_s":0.623304,"scheduling_latency_s":0.623321}1592vm-test-run-nixbot-gitlab> gitlab # [  291.134227] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93bf9944437cce423df0e635","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93bf9944437cce423df0e635: done: 0.014705 sec","job_status":"done","queue_duration_s":0.623304,"scheduling_latency_s":0.623321,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010085,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014705,"completed_at":"2026-06-17T14:57:04.959Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593vm-test-run-nixbot-gitlab> gitlab # [  291.171996] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec41f9934afe617c1ba964cb","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec41f9934afe617c1ba964cb: start","job_status":"start","queue_duration_s":0.639136,"scheduling_latency_s":0.639152}1594vm-test-run-nixbot-gitlab> gitlab # [  291.183909] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ec41f9934afe617c1ba964cb","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ec41f9934afe617c1ba964cb: done: 0.014307 sec","job_status":"done","queue_duration_s":0.639136,"scheduling_latency_s":0.639152,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009795,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014307,"completed_at":"2026-06-17T14:57:04.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595vm-test-run-nixbot-gitlab> gitlab # [  291.222484] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c160fe6a49b8e957d9eec0e8","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c160fe6a49b8e957d9eec0e8: start","job_status":"start","queue_duration_s":0.654547,"scheduling_latency_s":0.654564}1596vm-test-run-nixbot-gitlab> gitlab # [  291.234481] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c160fe6a49b8e957d9eec0e8","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c160fe6a49b8e957d9eec0e8: done: 0.014154 sec","job_status":"done","queue_duration_s":0.654547,"scheduling_latency_s":0.654564,"redis_calls":13,"redis_duration_s":0.0014520000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014154,"completed_at":"2026-06-17T14:57:04.990Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597vm-test-run-nixbot-gitlab> gitlab # [  291.271871] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:04.991Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a95b1d3660fed47967afd62a","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a95b1d3660fed47967afd62a: start","job_status":"start","queue_duration_s":0.669795,"scheduling_latency_s":0.669811}1598vm-test-run-nixbot-gitlab> gitlab # [  291.283847] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a95b1d3660fed47967afd62a","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a95b1d3660fed47967afd62a: done: 0.014455 sec","job_status":"done","queue_duration_s":0.669795,"scheduling_latency_s":0.669811,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009941,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014455,"completed_at":"2026-06-17T14:57:05.005Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599vm-test-run-nixbot-gitlab> gitlab # [  291.323227] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.007Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d39e82544fb4b1190330b8c6","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d39e82544fb4b1190330b8c6: start","job_status":"start","queue_duration_s":0.68561,"scheduling_latency_s":0.685627}1600vm-test-run-nixbot-gitlab> gitlab # [  291.335333] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.021Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d39e82544fb4b1190330b8c6","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d39e82544fb4b1190330b8c6: done: 0.014605 sec","job_status":"done","queue_duration_s":0.68561,"scheduling_latency_s":0.685627,"redis_calls":13,"redis_duration_s":0.001652,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000731,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014605,"completed_at":"2026-06-17T14:57:05.021Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601vm-test-run-nixbot-gitlab> gitlab # [  291.372675] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.022Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09672e4c6bef2a33c92f33a2","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09672e4c6bef2a33c92f33a2: start","job_status":"start","queue_duration_s":0.701298,"scheduling_latency_s":0.701314}1602vm-test-run-nixbot-gitlab> gitlab # [  291.384423] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.037Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"09672e4c6bef2a33c92f33a2","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-09672e4c6bef2a33c92f33a2: done: 0.014272 sec","job_status":"done","queue_duration_s":0.701298,"scheduling_latency_s":0.701314,"redis_calls":13,"redis_duration_s":0.001429,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009793,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014272,"completed_at":"2026-06-17T14:57:05.037Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603vm-test-run-nixbot-gitlab> gitlab # [  291.422912] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.038Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77d0b9c98372ab18d5fd3647","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77d0b9c98372ab18d5fd3647: start","job_status":"start","queue_duration_s":0.716703,"scheduling_latency_s":0.71672}1604vm-test-run-nixbot-gitlab> gitlab # [  291.434704] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77d0b9c98372ab18d5fd3647","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77d0b9c98372ab18d5fd3647: done: 0.014293 sec","job_status":"done","queue_duration_s":0.716703,"scheduling_latency_s":0.71672,"redis_calls":13,"redis_duration_s":0.001461,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014293,"completed_at":"2026-06-17T14:57:05.052Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605vm-test-run-nixbot-gitlab> gitlab # [  291.471349] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.053Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcdf8ee3e4bec8d89768b088","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcdf8ee3e4bec8d89768b088: start","job_status":"start","queue_duration_s":0.732115,"scheduling_latency_s":0.732132}1606vm-test-run-nixbot-gitlab> gitlab # [  291.483014] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.067Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bcdf8ee3e4bec8d89768b088","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bcdf8ee3e4bec8d89768b088: done: 0.014236 sec","job_status":"done","queue_duration_s":0.732115,"scheduling_latency_s":0.732132,"redis_calls":13,"redis_duration_s":0.001387,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009702,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014236,"completed_at":"2026-06-17T14:57:05.067Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607vm-test-run-nixbot-gitlab> gitlab # [  291.519413] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bc9acd10ad03cea12e772c8","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bc9acd10ad03cea12e772c8: start","job_status":"start","queue_duration_s":0.747418,"scheduling_latency_s":0.747434}1608vm-test-run-nixbot-gitlab> gitlab # [  291.531206] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.083Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4bc9acd10ad03cea12e772c8","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4bc9acd10ad03cea12e772c8: done: 0.014133 sec","job_status":"done","queue_duration_s":0.747418,"scheduling_latency_s":0.747434,"redis_calls":13,"redis_duration_s":0.001399,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014133,"completed_at":"2026-06-17T14:57:05.082Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609vm-test-run-nixbot-gitlab> gitlab # [  291.567664] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed450fac93478798922d18ba","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed450fac93478798922d18ba: start","job_status":"start","queue_duration_s":0.762671,"scheduling_latency_s":0.762687}1610vm-test-run-nixbot-gitlab> gitlab # [  291.579491] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.098Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ed450fac93478798922d18ba","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ed450fac93478798922d18ba: done: 0.014362 sec","job_status":"done","queue_duration_s":0.762671,"scheduling_latency_s":0.762687,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000561,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009865,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014362,"completed_at":"2026-06-17T14:57:05.098Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611vm-test-run-nixbot-gitlab> gitlab # [  291.615837] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"441f26a87a03a50bfc57fe66","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-441f26a87a03a50bfc57fe66: start","job_status":"start","queue_duration_s":0.778096,"scheduling_latency_s":0.778112}1612vm-test-run-nixbot-gitlab> gitlab # [  291.628564] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.114Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"441f26a87a03a50bfc57fe66","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-441f26a87a03a50bfc57fe66: done: 0.014491 sec","job_status":"done","queue_duration_s":0.778096,"scheduling_latency_s":0.778112,"redis_calls":13,"redis_duration_s":0.001637,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001101,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014491,"completed_at":"2026-06-17T14:57:05.114Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613vm-test-run-nixbot-gitlab> gitlab # [  291.664833] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.115Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f4ba87af00e807137265007","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f4ba87af00e807137265007: start","job_status":"start","queue_duration_s":0.793699,"scheduling_latency_s":0.793714}1614vm-test-run-nixbot-gitlab> gitlab # [  291.676361] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4f4ba87af00e807137265007","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4f4ba87af00e807137265007: done: 0.014324 sec","job_status":"done","queue_duration_s":0.793699,"scheduling_latency_s":0.793714,"redis_calls":13,"redis_duration_s":0.001411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014324,"completed_at":"2026-06-17T14:57:05.129Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615vm-test-run-nixbot-gitlab> gitlab # [  291.712493] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c71357ae0b9ce85a6c3d21c","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c71357ae0b9ce85a6c3d21c: start","job_status":"start","queue_duration_s":0.809173,"scheduling_latency_s":0.80919}1616vm-test-run-nixbot-gitlab> gitlab # [  291.723858] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.145Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c71357ae0b9ce85a6c3d21c","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c71357ae0b9ce85a6c3d21c: done: 0.014721 sec","job_status":"done","queue_duration_s":0.809173,"scheduling_latency_s":0.80919,"redis_calls":13,"redis_duration_s":0.0018419999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009811,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014721,"completed_at":"2026-06-17T14:57:05.145Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617vm-test-run-nixbot-gitlab> gitlab # [  291.760799] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e77570c445d14ce4e2d00d1","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e77570c445d14ce4e2d00d1: start","job_status":"start","queue_duration_s":0.825021,"scheduling_latency_s":0.825037}1618vm-test-run-nixbot-gitlab> gitlab # [  291.772381] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.160Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1e77570c445d14ce4e2d00d1","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1e77570c445d14ce4e2d00d1: done: 0.01422 sec","job_status":"done","queue_duration_s":0.825021,"scheduling_latency_s":0.825037,"redis_calls":13,"redis_duration_s":0.001402,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01422,"completed_at":"2026-06-17T14:57:05.160Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619vm-test-run-nixbot-gitlab> gitlab # [  291.809036] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.161Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53c6d6f50923d3dafbf671b1","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53c6d6f50923d3dafbf671b1: start","job_status":"start","queue_duration_s":0.840301,"scheduling_latency_s":0.840316}1620vm-test-run-nixbot-gitlab> gitlab # [  291.820839] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.176Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"53c6d6f50923d3dafbf671b1","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-53c6d6f50923d3dafbf671b1: done: 0.014333 sec","job_status":"done","queue_duration_s":0.840301,"scheduling_latency_s":0.840316,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000938,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014333,"completed_at":"2026-06-17T14:57:05.176Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621vm-test-run-nixbot-gitlab> gitlab # [  291.858433] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.177Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a10229311604de515f780dba","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a10229311604de515f780dba: start","job_status":"start","queue_duration_s":0.855738,"scheduling_latency_s":0.855754}1622vm-test-run-nixbot-gitlab> gitlab # [  291.870239] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.191Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a10229311604de515f780dba","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a10229311604de515f780dba: done: 0.014157 sec","job_status":"done","queue_duration_s":0.855738,"scheduling_latency_s":0.855754,"redis_calls":13,"redis_duration_s":0.001417,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009713,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014157,"completed_at":"2026-06-17T14:57:05.191Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623vm-test-run-nixbot-gitlab> gitlab # [  291.907213] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.192Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9d1efd0d8be95c3eb2dda7b","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9d1efd0d8be95c3eb2dda7b: start","job_status":"start","queue_duration_s":0.871039,"scheduling_latency_s":0.871055}1624vm-test-run-nixbot-gitlab> gitlab # [  291.918898] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.206Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e9d1efd0d8be95c3eb2dda7b","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e9d1efd0d8be95c3eb2dda7b: done: 0.014424 sec","job_status":"done","queue_duration_s":0.871039,"scheduling_latency_s":0.871055,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009891,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014424,"completed_at":"2026-06-17T14:57:05.206Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625vm-test-run-nixbot-gitlab> gitlab # [  291.955665] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c781f161770a3f55439c75f6","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c781f161770a3f55439c75f6: start","job_status":"start","queue_duration_s":0.886885,"scheduling_latency_s":0.886903}1626vm-test-run-nixbot-gitlab> gitlab # [  291.967607] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.222Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c781f161770a3f55439c75f6","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c781f161770a3f55439c75f6: done: 0.014178 sec","job_status":"done","queue_duration_s":0.886885,"scheduling_latency_s":0.886903,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014178,"completed_at":"2026-06-17T14:57:05.222Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627vm-test-run-nixbot-gitlab> gitlab # [  292.005080] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"562444d44fdaf341d874f11b","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-562444d44fdaf341d874f11b: start","job_status":"start","queue_duration_s":0.90212,"scheduling_latency_s":0.902135}1628vm-test-run-nixbot-gitlab> gitlab # [  292.016800] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"562444d44fdaf341d874f11b","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-562444d44fdaf341d874f11b: done: 0.05629 sec","job_status":"done","queue_duration_s":0.90212,"scheduling_latency_s":0.902135,"redis_calls":13,"redis_duration_s":0.001546,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000643,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051597,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.05629,"completed_at":"2026-06-17T14:57:05.279Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629vm-test-run-nixbot-gitlab> gitlab # [  292.054697] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.281Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e95e96b46050537c96f80cf","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e95e96b46050537c96f80cf: start","job_status":"start","queue_duration_s":0.959503,"scheduling_latency_s":0.959519}1630vm-test-run-nixbot-gitlab> gitlab # [  292.066625] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9e95e96b46050537c96f80cf","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9e95e96b46050537c96f80cf: done: 0.014023 sec","job_status":"done","queue_duration_s":0.959503,"scheduling_latency_s":0.959519,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000509,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000889,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009541,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014023,"completed_at":"2026-06-17T14:57:05.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631vm-test-run-nixbot-gitlab> gitlab # [  292.103833] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.296Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5f648fa5ac7cd8d3ac0fcc7","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5f648fa5ac7cd8d3ac0fcc7: start","job_status":"start","queue_duration_s":0.975355,"scheduling_latency_s":0.975371}1632vm-test-run-nixbot-gitlab> gitlab # [  292.115854] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.312Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5f648fa5ac7cd8d3ac0fcc7","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5f648fa5ac7cd8d3ac0fcc7: done: 0.015419 sec","job_status":"done","queue_duration_s":0.975355,"scheduling_latency_s":0.975371,"redis_calls":13,"redis_duration_s":0.001691,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000749,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000942,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015419,"completed_at":"2026-06-17T14:57:05.312Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633vm-test-run-nixbot-gitlab> gitlab # [  292.152834] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.313Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c49a0d07c7a922edfd76a0d","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c49a0d07c7a922edfd76a0d: start","job_status":"start","queue_duration_s":0.991808,"scheduling_latency_s":0.991824}1634vm-test-run-nixbot-gitlab> gitlab # [  292.164481] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.328Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c49a0d07c7a922edfd76a0d","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c49a0d07c7a922edfd76a0d: done: 0.01533 sec","job_status":"done","queue_duration_s":0.991808,"scheduling_latency_s":0.991824,"redis_calls":13,"redis_duration_s":0.002604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001696,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010873,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01533,"completed_at":"2026-06-17T14:57:05.328Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635vm-test-run-nixbot-gitlab> gitlab # [  292.201037] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.329Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bbdcb1614409970195c018f","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bbdcb1614409970195c018f: start","job_status":"start","queue_duration_s":1.00819,"scheduling_latency_s":1.008205}1636vm-test-run-nixbot-gitlab> gitlab # [  292.212679] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.348Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6bbdcb1614409970195c018f","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6bbdcb1614409970195c018f: done: 0.018552 sec","job_status":"done","queue_duration_s":1.00819,"scheduling_latency_s":1.008205,"redis_calls":16,"redis_duration_s":0.001784,"redis_read_bytes":394,"redis_write_bytes":1341,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000341,"redis_feature_flag_read_bytes":384,"redis_feature_flag_write_bytes":184,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011279,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018552,"completed_at":"2026-06-17T14:57:05.348Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637vm-test-run-nixbot-gitlab> gitlab # [  292.251824] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0c3d5fbc082337486aa448e","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0c3d5fbc082337486aa448e: start","job_status":"start","queue_duration_s":1.027871,"scheduling_latency_s":1.027887}1638vm-test-run-nixbot-gitlab> gitlab # [  292.263527] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.365Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0c3d5fbc082337486aa448e","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0c3d5fbc082337486aa448e: done: 0.016092 sec","job_status":"done","queue_duration_s":1.027871,"scheduling_latency_s":1.027887,"redis_calls":14,"redis_duration_s":0.001618,"redis_read_bytes":138,"redis_write_bytes":1269,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000136,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":112,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016092,"completed_at":"2026-06-17T14:57:05.365Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639vm-test-run-nixbot-gitlab> gitlab # [  292.302122] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.366Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df24e0f4b873f05e14de043c","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df24e0f4b873f05e14de043c: start","job_status":"start","queue_duration_s":1.045065,"scheduling_latency_s":1.045082}1640vm-test-run-nixbot-gitlab> gitlab # [  292.313885] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"df24e0f4b873f05e14de043c","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-df24e0f4b873f05e14de043c: done: 0.016589 sec","job_status":"done","queue_duration_s":1.045065,"scheduling_latency_s":1.045082,"redis_calls":13,"redis_duration_s":0.0014550000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016589,"completed_at":"2026-06-17T14:57:05.383Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641vm-test-run-nixbot-gitlab> gitlab # [  292.351171] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.384Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07358b243879736bbec0e0bb","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07358b243879736bbec0e0bb: start","job_status":"start","queue_duration_s":1.062811,"scheduling_latency_s":1.062827}1642vm-test-run-nixbot-gitlab> gitlab # [  292.362888] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07358b243879736bbec0e0bb","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07358b243879736bbec0e0bb: done: 0.01559 sec","job_status":"done","queue_duration_s":1.062811,"scheduling_latency_s":1.062827,"redis_calls":13,"redis_duration_s":0.001446,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011039,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01559,"completed_at":"2026-06-17T14:57:05.399Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643vm-test-run-nixbot-gitlab> gitlab # [  292.399957] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.400Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cebb966c8c1ebee3bf88f25c","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cebb966c8c1ebee3bf88f25c: start","job_status":"start","queue_duration_s":1.079431,"scheduling_latency_s":1.079446}1644vm-test-run-nixbot-gitlab> gitlab # [  292.411792] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cebb966c8c1ebee3bf88f25c","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cebb966c8c1ebee3bf88f25c: done: 0.015974 sec","job_status":"done","queue_duration_s":1.079431,"scheduling_latency_s":1.079446,"redis_calls":13,"redis_duration_s":0.001503,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000558,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000945,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015974,"completed_at":"2026-06-17T14:57:05.416Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645vm-test-run-nixbot-gitlab> gitlab # [  292.449838] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.419Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"453a6bb627aaa0f0ed4a9c2f","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-453a6bb627aaa0f0ed4a9c2f: start","job_status":"start","queue_duration_s":1.09751,"scheduling_latency_s":1.097527}1646vm-test-run-nixbot-gitlab> gitlab # [  292.461506] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.434Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"453a6bb627aaa0f0ed4a9c2f","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-453a6bb627aaa0f0ed4a9c2f: done: 0.015323 sec","job_status":"done","queue_duration_s":1.09751,"scheduling_latency_s":1.097527,"redis_calls":13,"redis_duration_s":0.001497,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015323,"completed_at":"2026-06-17T14:57:05.434Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647vm-test-run-nixbot-gitlab> gitlab # [  292.498454] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.435Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"835f85361d774244b8d542f1","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-835f85361d774244b8d542f1: start","job_status":"start","queue_duration_s":1.113871,"scheduling_latency_s":1.113887}1648vm-test-run-nixbot-gitlab> gitlab # [  292.510364] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.450Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"835f85361d774244b8d542f1","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-835f85361d774244b8d542f1: done: 0.015076 sec","job_status":"done","queue_duration_s":1.113871,"scheduling_latency_s":1.113887,"redis_calls":13,"redis_duration_s":0.001449,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015076,"completed_at":"2026-06-17T14:57:05.450Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649vm-test-run-nixbot-gitlab> gitlab # [  292.547536] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.451Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8844b2f7d7284b2834fa769c","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8844b2f7d7284b2834fa769c: start","job_status":"start","queue_duration_s":1.129984,"scheduling_latency_s":1.129999}1650vm-test-run-nixbot-gitlab> gitlab # [  292.559371] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.466Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8844b2f7d7284b2834fa769c","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8844b2f7d7284b2834fa769c: done: 0.015286 sec","job_status":"done","queue_duration_s":1.129984,"scheduling_latency_s":1.129999,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000525,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010808,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015286,"completed_at":"2026-06-17T14:57:05.466Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651vm-test-run-nixbot-gitlab> gitlab # [  292.596054] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.467Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"476d34c446c5ebda818e4800","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-476d34c446c5ebda818e4800: start","job_status":"start","queue_duration_s":1.146372,"scheduling_latency_s":1.146388}1652vm-test-run-nixbot-gitlab> gitlab # [  292.607677] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:05.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"476d34c446c5ebda818e4800","created_at":"2026-06-17T14:57:04.249Z","trace_propagation_headers":{"sentry-trace":"d2d0d2958a594fc0b6410fba96052a83-ba4f5a7043fe496d","baggage":"sentry-trace_id=d2d0d2958a594fc0b6410fba96052a83,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"8f1d3e9d6af075bbd7045ed0f0e2dac9","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:04.321Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-476d34c446c5ebda818e4800: done: 0.017062 sec","job_status":"done","queue_duration_s":1.146372,"scheduling_latency_s":1.146388,"redis_calls":13,"redis_duration_s":0.001411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017062,"completed_at":"2026-06-17T14:57:05.484Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1653vm-test-run-nixbot-gitlab> gitlab # [  301.529516] runuser[3310]: pam_unix(runuser:session): session closed for user gitlab1654vm-test-run-nixbot-gitlab> gitlab # [  301.533474] setup-gitlab-start[3662]: +++ date -d '+7 days' +%F1655vm-test-run-nixbot-gitlab> gitlab # [  301.536947] setup-gitlab-start[3661]: ++ jq -r .token1656vm-test-run-nixbot-gitlab> gitlab # [  301.539803] setup-gitlab-start[3660]: ++ curl -fs -X POST -H 'Authorization: Bearer eb833868d9cf78c3e461b7ab4dbc2d850468baa9b14721e5c84330ca7711b75c' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-06-24"}' http://gitlab/api/v4/users/1/personal_access_tokens1657vm-test-run-nixbot-gitlab> gitlab # [  301.825000] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:16.754Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"e490a1190ca99937998e6f13","created_at":"2026-06-17T14:57:16.719Z","trace_propagation_headers":{"sentry-trace":"f83a51fd12da41cb8cf6ecba7835ad60-103a9b4a6edc4b8d","baggage":"sentry-trace_id=f83a51fd12da41cb8cf6ecba7835ad60,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1C9PAM0M7D860MCJ0978Y","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:512f86bfadc0e1714ca247f93eee5a1ac46261cea9aea1e795bb53ce001ee98f","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:16.747Z","job_size_bytes":451,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-e490a1190ca99937998e6f13: start","job_status":"start","queue_duration_s":0.006711,"scheduling_latency_s":0.006773}1658vm-test-run-nixbot-gitlab> gitlab # [  301.871033] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:16 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 2671659vm-test-run-nixbot-gitlab> gitlab # [  301.877039] setup-gitlab-start[3267]: + TOKEN=glpat-FLXbzi_02hvlD77eOCTwxm86MQp1OjEH.01.0w1ueq7bs1660vm-test-run-nixbot-gitlab> gitlab # [  301.879894] setup-gitlab-start[3267]: + test -n glpat-FLXbzi_02hvlD77eOCTwxm86MQp1OjEH.01.0w1ueq7bs1661vm-test-run-nixbot-gitlab> gitlab # [  301.882668] setup-gitlab-start[3267]: + test glpat-FLXbzi_02hvlD77eOCTwxm86MQp1OjEH.01.0w1ueq7bs '!=' null1662vm-test-run-nixbot-gitlab> gitlab # [  301.885484] setup-gitlab-start[3267]: + mkdir -p /var/lib/secrets1663vm-test-run-nixbot-gitlab> gitlab # [  301.887289] setup-gitlab-start[3267]: + echo glpat-FLXbzi_02hvlD77eOCTwxm86MQp1OjEH.01.0w1ueq7bs1664vm-test-run-nixbot-gitlab> gitlab # [  301.889905] setup-gitlab-start[3267]: + chmod 644 /var/lib/secrets/gitlab-token1665vm-test-run-nixbot-gitlab> gitlab # [  301.892069] setup-gitlab-start[3267]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-FLXbzi_02hvlD77eOCTwxm86MQp1OjEH.01.0w1ueq7bs' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1666vm-test-run-nixbot-gitlab> gitlab # [  302.020214] sidekiq-cluster[2420]: {"severity":"WARN","time":"2026-06-17T14:57:16.950Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"e490a1190ca99937998e6f13","created_at":"2026-06-17T14:57:16.719Z","trace_propagation_headers":{"sentry-trace":"f83a51fd12da41cb8cf6ecba7835ad60-103a9b4a6edc4b8d","baggage":"sentry-trace_id=f83a51fd12da41cb8cf6ecba7835ad60,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1C9PAM0M7D860MCJ0978Y","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:512f86bfadc0e1714ca247f93eee5a1ac46261cea9aea1e795bb53ce001ee98f","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:16.747Z","job_size_bytes":451,"pid":2420,"sidekiq_tid":"lyls","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-e490a1190ca99937998e6f13: fail: 0.195276 sec","job_status":"fail","queue_duration_s":0.006711,"scheduling_latency_s":0.006773,"redis_calls":11,"redis_duration_s":0.005332,"redis_read_bytes":137,"redis_write_bytes":1317,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001342,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00305,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.022,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.022,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.142674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00061308,"duration_s":0.195276,"completed_at":"2026-06-17T14:57:16.949Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/w9mp1gyfs2qdv12r0ji70idzndmxwz2s-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/qr8jwlszzf80b9yy5410msfvxfhdlv3q-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/p8ylyr0sj9sxcknqcpja13nypqixk2dp-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/dmv1shq667w4j882d6hfknpqjgmsjk3d-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/dmv1shq667w4j882d6hfknpqjgmsjk3d-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/dndr7b4a17339dsm67vzb6nv4p2kp82q-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/qr8jwlszzf80b9yy5410msfvxfhdlv3q-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/zx6ndpscxs64hnidz69ab430ccms6rak-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.036015,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1667vm-test-run-nixbot-gitlab> gitlab # [  302.511256] gitaly[1358]: time="2026-06-17T14:57:17.434Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-17T14:57:27.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.434" pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1668vm-test-run-nixbot-gitlab> gitlab # [  302.520151] gitaly[1358]: time="2026-06-17T14:57:17.434Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-17T14:57:27.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.434" grpc.time_ms=0.379 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1669vm-test-run-nixbot-gitlab> gitlab # [  302.685853] gitaly[1358]: time="2026-06-17T14:57:17.617Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-17T14:57:27.186" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.616" pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1670vm-test-run-nixbot-gitlab> gitlab # [  302.716646] gitaly[1358]: time="2026-06-17T14:57:17.617Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-17T14:57:27.186" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.616" grpc.time_ms=0.587 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1671vm-test-run-nixbot-gitlab> gitlab # [  302.748324] gitaly[1358]: time="2026-06-17T14:57:17.660Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ diskcache=240bb194-6100-499c-aeb6-de742452642b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-17T14:57:27.200" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.630" pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1672vm-test-run-nixbot-gitlab> gitlab # [  302.770552] gitaly[1358]: time="2026-06-17T14:57:17.660Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=300 command.oublock=32 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-17T14:57:27.200" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.630" grpc.time_ms=29.596 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1673vm-test-run-nixbot-gitlab> gitlab # [  302.792485] gitaly[1358]: time="2026-06-17T14:57:17.681Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-17T14:57:27.249" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.680" pid=1358 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1674vm-test-run-nixbot-gitlab> gitlab # [  302.808124] gitaly[1358]: time="2026-06-17T14:57:17.681Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-17T14:57:27.249" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.680" grpc.time_ms=1.278 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1675vm-test-run-nixbot-gitlab> gitlab # [  302.824386] gitaly[1358]: time="2026-06-17T14:57:17.710Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=19 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-17T14:57:27.258" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.689" grpc.time_ms=20.644 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1676vm-test-run-nixbot-gitlab> gitlab # [  302.843987] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:17.751Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"3a392bc7610b6d4bf392c7f7","created_at":"2026-06-17T14:57:17.726Z","trace_propagation_headers":{"sentry-trace":"06d4c35757e24e74beb684bf55965b30-f870361506424649","baggage":"sentry-trace_id=06d4c35757e24e74beb684bf55965b30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1C9ZEMP6VMNVMEMWAK5FJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:17.748Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-3a392bc7610b6d4bf392c7f7: start","job_status":"start","queue_duration_s":0.003666,"scheduling_latency_s":0.003785}1677vm-test-run-nixbot-gitlab> gitlab # [  302.861635] gitaly[1358]: time="2026-06-17T14:57:17.790Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-17T14:57:27.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.790" pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1678vm-test-run-nixbot-gitlab> gitlab # [  302.872697] gitaly[1358]: time="2026-06-17T14:57:17.791Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-17T14:57:27.009" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.790" grpc.time_ms=0.47 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1679vm-test-run-nixbot-gitlab> gitlab # [  302.897503] gitaly[1358]: time="2026-06-17T14:57:17.829Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ diskcache=89b8b389-5e01-4b27-81b8-ba46af84dd30 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-17T14:57:27.015" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.796" pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1680vm-test-run-nixbot-gitlab> gitlab # [  302.910396] gitaly[1358]: time="2026-06-17T14:57:17.829Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=32 command.real_time_ms=17 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-17T14:57:27.015" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.796" grpc.time_ms=32.724 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1681vm-test-run-nixbot-gitlab> gitlab # [  302.926860] gitaly[1358]: time="2026-06-17T14:57:17.855Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-17T14:57:27.072" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.853" pid=1358 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1682vm-test-run-nixbot-gitlab> gitlab # [  302.938394] gitaly[1358]: time="2026-06-17T14:57:17.856Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-17T14:57:27.072" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.853" grpc.time_ms=1.7 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1683vm-test-run-nixbot-gitlab> gitlab # [  302.949697] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:17.874Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"3a392bc7610b6d4bf392c7f7","created_at":"2026-06-17T14:57:17.726Z","trace_propagation_headers":{"sentry-trace":"06d4c35757e24e74beb684bf55965b30-f870361506424649","baggage":"sentry-trace_id=06d4c35757e24e74beb684bf55965b30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1C9ZEMP6VMNVMEMWAK5FJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:17.748Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-3a392bc7610b6d4bf392c7f7: done: 0.123317 sec","job_status":"done","queue_duration_s":0.003666,"scheduling_latency_s":0.003785,"redis_calls":13,"redis_duration_s":0.006037,"redis_read_bytes":138,"redis_write_bytes":1593,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001293,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":428,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002862,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001882,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.09692,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06863794,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.123317,"completed_at":"2026-06-17T14:57:17.874Z","load_balancing_strategy":"primary","db_duration_s":0.012755,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1684vm-test-run-nixbot-gitlab> gitlab # [  302.991409] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:17.878Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"0e5104fa100ad6b7250a4a9e","created_at":"2026-06-17T14:57:17.764Z","trace_propagation_headers":{"sentry-trace":"06d4c35757e24e74beb684bf55965b30-f870361506424649","baggage":"sentry-trace_id=06d4c35757e24e74beb684bf55965b30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1C9ZEMP6VMNVMEMWAK5FJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:17.777Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-0e5104fa100ad6b7250a4a9e: start","job_status":"start","queue_duration_s":0.100022,"scheduling_latency_s":0.100063}1685vm-test-run-nixbot-gitlab> gitlab # [  303.005046] gitaly[1358]: time="2026-06-17T14:57:17.884Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=16 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-17T14:57:27.083" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.864" grpc.time_ms=19.921 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1686vm-test-run-nixbot-gitlab> gitlab # [  303.021499] gitaly[1358]: time="2026-06-17T14:57:17.953Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-17T14:57:27.172" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.952" grpc.time_ms=0.24 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1687vm-test-run-nixbot-gitlab> gitlab # [  303.033574] gitaly[1358]: time="2026-06-17T14:57:17.965Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-17T14:57:27.183" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:17.964" grpc.time_ms=0.517 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1688vm-test-run-nixbot-gitlab> gitlab # [  303.114612] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:18.045Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"0e5104fa100ad6b7250a4a9e","created_at":"2026-06-17T14:57:17.764Z","trace_propagation_headers":{"sentry-trace":"06d4c35757e24e74beb684bf55965b30-f870361506424649","baggage":"sentry-trace_id=06d4c35757e24e74beb684bf55965b30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1C9ZEMP6VMNVMEMWAK5FJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:17.777Z","job_size_bytes":2,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-0e5104fa100ad6b7250a4a9e: done: 0.167795 sec","job_status":"done","queue_duration_s":0.100022,"scheduling_latency_s":0.100063,"redis_calls":14,"redis_duration_s":0.003552,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000732,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001677,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.116961,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.12845052,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.167795,"completed_at":"2026-06-17T14:57:18.045Z","load_balancing_strategy":"primary","db_duration_s":0.041984,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1689vm-test-run-nixbot-gitlab> gitlab # [  303.368698] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:18.299Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"ca54ef8b708173b41f9c22ed","created_at":"2026-06-17T14:57:18.286Z","trace_propagation_headers":{"sentry-trace":"06d4c35757e24e74beb684bf55965b30-f870361506424649","baggage":"sentry-trace_id=06d4c35757e24e74beb684bf55965b30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1C9ZEMP6VMNVMEMWAK5FJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:18.296Z","job_size_bytes":5,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-ca54ef8b708173b41f9c22ed: start","job_status":"start","queue_duration_s":0.002299,"scheduling_latency_s":0.002355}1690vm-test-run-nixbot-gitlab> gitlab # [  303.477156] gitaly[1358]: time="2026-06-17T14:57:18.408Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1C9ZEMP6VMNVMEMWAK5FJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-17T14:57:28.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:18.392" grpc.time_ms=15.416 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1691vm-test-run-nixbot-gitlab> gitlab # [  303.603120] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:18.533Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"ca54ef8b708173b41f9c22ed","created_at":"2026-06-17T14:57:18.286Z","trace_propagation_headers":{"sentry-trace":"06d4c35757e24e74beb684bf55965b30-f870361506424649","baggage":"sentry-trace_id=06d4c35757e24e74beb684bf55965b30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1C9ZEMP6VMNVMEMWAK5FJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:18.296Z","job_size_bytes":5,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-ca54ef8b708173b41f9c22ed: done: 0.234598 sec","job_status":"done","queue_duration_s":0.002299,"scheduling_latency_s":0.002355,"redis_calls":12,"redis_duration_s":0.00637,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001548,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003819,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001003,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.023,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.18775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.000753,"duration_s":0.234598,"completed_at":"2026-06-17T14:57:18.533Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.034307,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1692vm-test-run-nixbot-gitlab> gitlab # [  303.690862] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:18.537Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"75dc4001fb5baafc3114232b","created_at":"2026-06-17T14:57:18.336Z","trace_propagation_headers":{"sentry-trace":"06d4c35757e24e74beb684bf55965b30-f870361506424649","baggage":"sentry-trace_id=06d4c35757e24e74beb684bf55965b30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1C9ZEMP6VMNVMEMWAK5FJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:18.343Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-75dc4001fb5baafc3114232b: start","job_status":"start","queue_duration_s":0.194032,"scheduling_latency_s":0.194087}1693vm-test-run-nixbot-gitlab> gitlab # [  303.884903] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:18 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 20331694vm-test-run-nixbot-gitlab> gitlab # [  303.889176] setup-gitlab-start[3267]: + mkdir -p /tmp/test-flake1695vm-test-run-nixbot-gitlab> gitlab # [  303.894139] setup-gitlab-start[3267]: + cd /tmp/test-flake1696vm-test-run-nixbot-gitlab> gitlab # [  303.894973] setup-gitlab-start[3267]: + git init -b master1697vm-test-run-nixbot-gitlab> gitlab # [  303.930236] setup-gitlab-start[3701]: Initialized empty Git repository in /tmp/test-flake/.git/1698vm-test-run-nixbot-gitlab> gitlab # [  303.932001] setup-gitlab-start[3267]: + git config user.name test1699vm-test-run-nixbot-gitlab> gitlab # [  303.937955] setup-gitlab-start[3267]: + git config user.email test@example.com1700vm-test-run-nixbot-gitlab> gitlab # [  303.945053] setup-gitlab-start[3267]: + cat1701vm-test-run-nixbot-gitlab> gitlab # [  303.951007] setup-gitlab-start[3267]: + git add flake.nix1702vm-test-run-nixbot-gitlab> gitlab # [  303.959498] setup-gitlab-start[3267]: + git commit -m 'initial commit'1703vm-test-run-nixbot-gitlab> gitlab # [  303.980513] setup-gitlab-start[3706]: [master (root-commit) 3f5c5dc] initial commit1704vm-test-run-nixbot-gitlab> gitlab # [  303.983504] setup-gitlab-start[3706]:  1 file changed, 10 insertions(+)1705vm-test-run-nixbot-gitlab> gitlab # [  303.986253] setup-gitlab-start[3706]:  create mode 100644 flake.nix1706vm-test-run-nixbot-gitlab> gitlab # [  303.988722] setup-gitlab-start[3267]: + git remote add origin http://oauth2:glpat-FLXbzi_02hvlD77eOCTwxm86MQp1OjEH.01.0w1ueq7bs@gitlab/root/test-flake.git1707vm-test-run-nixbot-gitlab> gitlab # [  303.993853] setup-gitlab-start[3267]: + git push -u origin master1708vm-test-run-nixbot-gitlab> gitlab # [  304.056826] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:18.986Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"75dc4001fb5baafc3114232b","created_at":"2026-06-17T14:57:18.336Z","trace_propagation_headers":{"sentry-trace":"06d4c35757e24e74beb684bf55965b30-f870361506424649","baggage":"sentry-trace_id=06d4c35757e24e74beb684bf55965b30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1C9ZEMP6VMNVMEMWAK5FJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:18.343Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-75dc4001fb5baafc3114232b: done: 0.448505 sec","job_status":"done","queue_duration_s":0.194032,"scheduling_latency_s":0.194087,"redis_calls":11,"redis_duration_s":0.005239000000000001,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001433,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002781,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001025,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.052,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.357,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.357,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.05,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.324213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0008361,"duration_s":0.448505,"completed_at":"2026-06-17T14:57:18.986Z","load_balancing_strategy":"primary","db_duration_s":0.13102,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1709vm-test-run-nixbot-gitlab> gitlab # [  304.138028] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:18.989Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"ca6427af208ee7563de99739","created_at":"2026-06-17T14:57:18.348Z","trace_propagation_headers":{"sentry-trace":"06d4c35757e24e74beb684bf55965b30-f870361506424649","baggage":"sentry-trace_id=06d4c35757e24e74beb684bf55965b30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1C9ZEMP6VMNVMEMWAK5FJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:18.358Z","job_size_bytes":89,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-ca6427af208ee7563de99739: start","job_status":"start","queue_duration_s":0.630625,"scheduling_latency_s":0.630665}1710vm-test-run-nixbot-gitlab> gitlab # [  304.160671] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 711711vm-test-run-nixbot-gitlab> gitlab # [  304.163243] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:19.074Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"ca6427af208ee7563de99739","created_at":"2026-06-17T14:57:18.348Z","trace_propagation_headers":{"sentry-trace":"06d4c35757e24e74beb684bf55965b30-f870361506424649","baggage":"sentry-trace_id=06d4c35757e24e74beb684bf55965b30,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1C9ZEMP6VMNVMEMWAK5FJ","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:18.358Z","job_size_bytes":89,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-ca6427af208ee7563de99739: done: 0.085517 sec","job_status":"done","queue_duration_s":0.630625,"scheduling_latency_s":0.630665,"redis_calls":11,"redis_duration_s":0.002499,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000828,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001231,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.052416,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027956,"duration_s":0.085517,"completed_at":"2026-06-17T14:57:19.074Z","load_balancing_strategy":"primary","db_duration_s":0.0239,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1712vm-test-run-nixbot-gitlab> gitlab # [  304.278139] gitaly[1358]: time="2026-06-17T14:57:19.208Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CC653DQYHASFCQ72S42E grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:19.193" grpc.time_ms=14.65 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1713vm-test-run-nixbot-gitlab> gitlab # [  304.299139] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:19 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 1641714vm-test-run-nixbot-gitlab> gitlab # [  305.160635] gitaly[1358]: time="2026-06-17T14:57:20.092Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=10 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-17T14:57:30.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:20.076" grpc.time_ms=15.584 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1715vm-test-run-nixbot-gitlab> gitlab # [  305.266251] gitaly[1358]: time="2026-06-17T14:57:20.197Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-06-17T14:57:50.079" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-06-17T14:57:20.180" grpc.time_ms=17.427 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1716vm-test-run-nixbot-gitlab> gitlab # [  305.355223] gitaly[1358]: time="2026-06-17T14:57:20.285Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 duration_ms=863ns method=POST pid=1358 status=200 url="http://unix/api/v4/internal/allowed"1717vm-test-run-nixbot-gitlab> gitlab # [  305.398027] gitaly[1358]: time="2026-06-17T14:57:20.329Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 duration_ms=43ns method=POST pid=1358 status=200 url="http://unix/api/v4/internal/pre_receive"1718vm-test-run-nixbot-gitlab> gitlab # [  305.412253] gitaly[1358]: time="2026-06-17T14:57:20.331Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5318 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:19.420" grpc.time_ms=909.244 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1719vm-test-run-nixbot-gitlab> gitlab # [  305.441461] gitaly[1358]: time="2026-06-17T14:57:20.369Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4788 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:20.368" grpc.time_ms=0.636 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1720vm-test-run-nixbot-gitlab> gitlab # [  305.493898] gitaly[1358]: time="2026-06-17T14:57:20.425Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:20.423" grpc.time_ms=0.671 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1721vm-test-run-nixbot-gitlab> gitlab # [  305.542541] gitaly[1358]: time="2026-06-17T14:57:20.474Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4789 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:20.473" grpc.time_ms=0.444 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1722vm-test-run-nixbot-gitlab> gitlab # [  305.734274] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:20.663Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3f5c5dc8ab8d0ef8b24eda2469b66ea53bab0658 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b5a252ade4e79148bc90b815","created_at":"2026-06-17T14:57:20.608Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-a81c0c25fddb4aad","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:20.658Z","job_size_bytes":185,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b5a252ade4e79148bc90b815: start","job_status":"start","queue_duration_s":0.0056,"scheduling_latency_s":0.005661}1723vm-test-run-nixbot-gitlab> gitlab # [  305.791105] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:20.719Z","message":"changes: \"0000000000000000000000000000000000000000 3f5c5dc8ab8d0ef8b24eda2469b66ea53bab0658 refs/heads/master\\n\""}1724vm-test-run-nixbot-gitlab> gitlab # [  305.800323] gitaly[1358]: time="2026-06-17T14:57:20.724Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-17T14:57:30.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:20.714" grpc.time_ms=9.504 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1725vm-test-run-nixbot-gitlab> gitlab # [  305.839622] gitaly[1358]: time="2026-06-17T14:57:20.770Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=22 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1435 command.oublock=0 command.real_time_ms=27 command.spawn_token_fork_ms=10 command.system_time_ms=19 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-06-17T14:57:30.027" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:20.738" grpc.time_ms=32.118 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1726vm-test-run-nixbot-gitlab> gitlab # [  305.863051] gitaly[1358]: time="2026-06-17T14:57:20.794Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=5 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-17T14:57:30.000" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:20.781" grpc.time_ms=13.159 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1727vm-test-run-nixbot-gitlab> gitlab # [  305.879247] gitaly[1358]: time="2026-06-17T14:57:20.794Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 duration_ms=254ns method=POST pid=1358 status=200 url="http://unix/api/v4/internal/post_receive"1728vm-test-run-nixbot-gitlab> gitlab # [  305.883841] gitaly[1358]: time="2026-06-17T14:57:20.795Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4812 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:20.539" grpc.time_ms=256.323 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1729vm-test-run-nixbot-gitlab> gitlab # [  305.894095] gitaly[1358]: time="2026-06-17T14:57:20.813Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 diskcache=63fcd08a-83fb-4cd4-b20a-1d19672b25cc grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:19.321" pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1730vm-test-run-nixbot-gitlab> gitlab # [  305.903927] systemd[1]: Finished setup-gitlab.service.1731vm-test-run-nixbot-gitlab> gitlab # [  305.905064] gitlab-workhorse[1290]: time="2026-06-17T14:57:20Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521732vm-test-run-nixbot-gitlab> gitlab # [  305.906811] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:20 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 15891733vm-test-run-nixbot-gitlab> gitlab # [  305.908793] setup-gitlab-start[3710]: To http://gitlab/root/test-flake.git1734vm-test-run-nixbot-gitlab> gitlab # [  305.909636] setup-gitlab-start[3710]:  * [new branch]      master -> master1735vm-test-run-nixbot-gitlab> gitlab # [  305.910500] setup-gitlab-start[3710]: branch 'master' set up to track 'origin/master'.1736vm-test-run-nixbot-gitlab> gitlab # [  305.911472] gitaly[1358]: time="2026-06-17T14:57:20.814Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=235 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13140 command.oublock=32 command.real_time_ms=1485 command.spawn_token_fork_ms=1 command.system_time_ms=131 command.user_time_ms=104 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:19.321" grpc.time_ms=1492.845 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1737vm-test-run-nixbot-gitlab> gitlab # [  305.924632] systemd[1]: Starting nixbot CI service...1738vm-test-run-nixbot-gitlab> gitlab # [  305.925385] gitaly[1358]: time="2026-06-17T14:57:20.817Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-17T14:57:30.021" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:20.801" grpc.time_ms=15.374 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1739vm-test-run-nixbot-gitlab> gitlab # [  305.952054] gitaly[1358]: time="2026-06-17T14:57:20.883Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=3 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-06-17T14:57:30.086" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:20.866" grpc.time_ms=17.002 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1740vm-test-run-nixbot-gitlab> gitlab # [  306.008291] gitaly[1358]: time="2026-06-17T14:57:20.939Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:20.939" grpc.time_ms=0.473 pid=1358 span.kind=server system=grpc1741vm-test-run-nixbot-gitlab> gitlab # [  306.052485] gitaly[1358]: time="2026-06-17T14:57:20.984Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3940 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:20.983" grpc.time_ms=0.419 pid=1358 span.kind=server system=grpc1742vm-test-run-nixbot-gitlab> gitlab # [  306.065148] gitaly[1358]: time="2026-06-17T14:57:20.996Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 diskcache=a8337879-1752-41dd-8c69-bc7f080d1e7c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-17T14:57:30.115" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:20.896" pid=1358 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1743vm-test-run-nixbot-gitlab> gitlab # [  306.076974] gitaly[1358]: time="2026-06-17T14:57:20.996Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=90 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4654 command.oublock=8 command.real_time_ms=94 command.spawn_token_fork_ms=1 command.system_time_ms=55 command.user_time_ms=35 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-17T14:57:30.115" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:20.896" grpc.time_ms=100.037 pid=1358 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1744vm-test-run-nixbot-gitlab> gitlab # [  306.092477] gitaly[1358]: time="2026-06-17T14:57:21.024Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-17T14:57:31.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:21.023" grpc.time_ms=0.149 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745vm-test-run-nixbot-gitlab> gitlab # [  306.107943] gitaly[1358]: time="2026-06-17T14:57:21.039Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=862 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-06-17T14:57:31.007" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:21.027" grpc.time_ms=11.698 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1746vm-test-run-nixbot-gitlab> gitlab # [  306.218124] gitaly[1358]: time="2026-06-17T14:57:21.149Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=312 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-06-17T14:57:51.041" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:21.141" grpc.time_ms=7.778 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747vm-test-run-nixbot-gitlab> gitlab # [  306.261261] gitaly[1358]: time="2026-06-17T14:57:21.192Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-17T14:57:31.171" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:21.192" grpc.time_ms=0.281 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1748vm-test-run-nixbot-gitlab> gitlab # [  306.290934] gitaly[1358]: time="2026-06-17T14:57:21.200Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-06-17T14:57:31.174" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-06-17T14:57:21.194" grpc.time_ms=5.682 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1749vm-test-run-nixbot-gitlab> gitlab # [  306.326446] gitaly[1358]: time="2026-06-17T14:57:21.253Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=5 command.system_time_ms=9 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-17T14:57:31.220" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:21.240" grpc.time_ms=12.793 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1750vm-test-run-nixbot-gitlab> gitlab # [  306.360395] gitaly[1358]: time="2026-06-17T14:57:21.273Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-17T14:57:31.242" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:21.262" grpc.time_ms=11.27 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1751vm-test-run-nixbot-gitlab> gitlab # [  306.389506] gitaly[1358]: time="2026-06-17T14:57:21.306Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=5 command.system_time_ms=4 command.user_time_ms=8 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-17T14:57:51.189" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:21.289" grpc.time_ms=16.924 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1752vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit setup-gitlab.service, in 307.34 seconds)1753vm-test-run-nixbot-gitlab> gitlab: waiting for unit nixbot.service1754vm-test-run-nixbot-gitlab> gitlab # [  306.826060] gitaly[1358]: time="2026-06-17T14:57:21.757Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-06-17T14:57:31.005" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:21.755" grpc.time_ms=1.575 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1755vm-test-run-nixbot-gitlab> gitlab # [  306.866820] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:21.796Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 3f5c5dc8ab8d0ef8b24eda2469b66ea53bab0658 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"b5a252ade4e79148bc90b815","created_at":"2026-06-17T14:57:20.608Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-a81c0c25fddb4aad","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:20.658Z","job_size_bytes":185,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-b5a252ade4e79148bc90b815: done: 1.132841 sec","job_status":"done","queue_duration_s":0.0056,"scheduling_latency_s":0.005661,"gitaly_calls":13,"gitaly_duration_s":0.271942,"redis_calls":199,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.082706,"redis_read_bytes":957,"redis_write_bytes":19724,"redis_cache_calls":14,"redis_cache_duration_s":0.003637,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":32,"redis_feature_flag_duration_s":0.028264,"redis_feature_flag_read_bytes":540,"redis_feature_flag_write_bytes":4279,"redis_queues_calls":8,"redis_queues_duration_s":0.001348,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4930,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.008047,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":90,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.024954,"redis_repository_cache_read_bytes":249,"redis_repository_cache_write_bytes":6237,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.016456,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":51,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":51,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.087,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":51,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.337,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.374,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.087,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.671285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.000925,"exclusive_lock_hold_duration_s":0.05484418,"duration_s":1.132841,"completed_at":"2026-06-17T14:57:21.796Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.143008,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1756vm-test-run-nixbot-gitlab> gitlab # [  306.995646] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:21.798Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d2d574d154cf47fcdb331f9e","created_at":"2026-06-17T14:57:20.820Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-5d7f9c1e07304c6b","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:20.831Z","job_size_bytes":46,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d2d574d154cf47fcdb331f9e: start","job_status":"start","queue_duration_s":0.967312,"scheduling_latency_s":0.967335}1757vm-test-run-nixbot-gitlab> gitlab # [  307.025573] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:21.913Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"d2d574d154cf47fcdb331f9e","created_at":"2026-06-17T14:57:20.820Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-5d7f9c1e07304c6b","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:20.831Z","job_size_bytes":46,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-d2d574d154cf47fcdb331f9e: done: 0.114892 sec","job_status":"done","queue_duration_s":0.967312,"scheduling_latency_s":0.967335,"gitaly_calls":2,"gitaly_duration_s":0.021603,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.009665,"redis_read_bytes":68,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.001342,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000836,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002108,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003959,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":752,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00142,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.016,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.016,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.062694,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00060374,"duration_s":0.114892,"completed_at":"2026-06-17T14:57:21.913Z","load_balancing_strategy":"primary","db_duration_s":0.022937,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1758vm-test-run-nixbot-gitlab> gitlab # [  307.099369] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:21.915Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"37707b548b05d6ff0c91f967","created_at":"2026-06-17T14:57:20.855Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-5d7f9c1e07304c6b","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:20.861Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-37707b548b05d6ff0c91f967: start","job_status":"start","queue_duration_s":1.053514,"scheduling_latency_s":1.053532}1759vm-test-run-nixbot-gitlab> gitlab # [  307.119359] gitaly[1358]: time="2026-06-17T14:57:21.855Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-06-17T20:57:21.850" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:21.851" grpc.time_ms=3.688 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1760vm-test-run-nixbot-gitlab> gitlab # [  307.133558] nixbot[3812]: {"ts": "2026-06-17T14:57:21.949Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1761vm-test-run-nixbot-gitlab> gitlab # [  307.135840] nixbot[3812]: {"ts": "2026-06-17T14:57:21.970Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1762vm-test-run-nixbot-gitlab> gitlab # [  307.138162] nixbot[3812]: {"ts": "2026-06-17T14:57:21.984Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1763vm-test-run-nixbot-gitlab> gitlab # [  307.140575] nixbot[3812]: {"ts": "2026-06-17T14:57:21.988Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1764vm-test-run-nixbot-gitlab> gitlab # [  307.142653] nixbot[3812]: {"ts": "2026-06-17T14:57:21.991Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1765vm-test-run-nixbot-gitlab> gitlab # [  307.144976] nixbot[3812]: {"ts": "2026-06-17T14:57:21.996Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1766vm-test-run-nixbot-gitlab> gitlab # [  307.147235] nixbot[3812]: {"ts": "2026-06-17T14:57:21.998Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1767vm-test-run-nixbot-gitlab> gitlab # [  307.149701] nixbot[3812]: {"ts": "2026-06-17T14:57:21.999Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1768vm-test-run-nixbot-gitlab> gitlab # [  307.151563] nixbot[3812]: {"ts": "2026-06-17T14:57:22.004Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1769vm-test-run-nixbot-gitlab> gitlab # [  307.153668] nixbot[3812]: {"ts": "2026-06-17T14:57:22.005Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1770vm-test-run-nixbot-gitlab> gitlab # [  307.155916] nixbot[3812]: {"ts": "2026-06-17T14:57:22.009Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1771vm-test-run-nixbot-gitlab> gitlab # [  307.158075] nixbot[3812]: {"ts": "2026-06-17T14:57:22.014Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1772vm-test-run-nixbot-gitlab> gitlab # [  307.160408] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:22.019Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"37707b548b05d6ff0c91f967","created_at":"2026-06-17T14:57:20.855Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-5d7f9c1e07304c6b","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:20.861Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-37707b548b05d6ff0c91f967: done: 0.104739 sec","job_status":"done","queue_duration_s":1.053514,"scheduling_latency_s":1.053532,"gitaly_calls":1,"gitaly_duration_s":0.033388,"redis_calls":15,"redis_duration_s":0.005805,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000547,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001562,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000896,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0028,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.013,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.023,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.013,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042177,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.07687999999999999,"duration_s":0.104739,"completed_at":"2026-06-17T14:57:22.019Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022433,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1773vm-test-run-nixbot-gitlab> gitlab # [  307.206229] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:22.021Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"8dbffc84210e42d50d8ec702","created_at":"2026-06-17T14:57:21.018Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-5d7f9c1e07304c6b","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:21.020Z","job_size_bytes":23,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8dbffc84210e42d50d8ec702: start","job_status":"start","queue_duration_s":1.000754,"scheduling_latency_s":1.000772}1774vm-test-run-nixbot-gitlab> gitlab # [  307.220898] gitaly[1358]: time="2026-06-17T14:57:21.878Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=593 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=4 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-06-17T14:57:51.766" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:21.867" grpc.time_ms=10.682 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1775vm-test-run-nixbot-gitlab> gitlab # [  307.233100] gitaly[1358]: time="2026-06-17T14:57:21.975Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 diskcache=43981bfa-be07-4ac2-9124-9d0210382e0a grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-17T20:57:21.943" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:21.944" pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1776vm-test-run-nixbot-gitlab> gitlab # [  307.242471] nixbot[3812]: {"ts": "2026-06-17T14:57:22.017Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1777vm-test-run-nixbot-gitlab> gitlab # [  307.244463] nixbot[3812]: {"ts": "2026-06-17T14:57:22.018Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1778vm-test-run-nixbot-gitlab> gitlab # [  307.246463] nixbot[3812]: {"ts": "2026-06-17T14:57:22.021Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1779vm-test-run-nixbot-gitlab> gitlab # [  307.248468] nixbot[3812]: {"ts": "2026-06-17T14:57:22.022Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1780vm-test-run-nixbot-gitlab> gitlab # [  307.250351] nixbot[3812]: {"ts": "2026-06-17T14:57:22.023Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1781vm-test-run-nixbot-gitlab> gitlab # [  307.252340] nixbot[3812]: {"ts": "2026-06-17T14:57:22.024Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1782vm-test-run-nixbot-gitlab> gitlab # [  307.254220] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:22.097Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"8dbffc84210e42d50d8ec702","created_at":"2026-06-17T14:57:21.018Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-5d7f9c1e07304c6b","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:21.020Z","job_size_bytes":23,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-8dbffc84210e42d50d8ec702: done: 0.076258 sec","job_status":"done","queue_duration_s":1.000754,"scheduling_latency_s":1.000772,"gitaly_calls":1,"gitaly_duration_s":0.018516,"redis_calls":16,"redis_duration_s":0.012885,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.001018,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001695,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.009355,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000817,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.076258,"completed_at":"2026-06-17T14:57:22.097Z","load_balancing_strategy":"primary","db_duration_s":0.004539,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1783vm-test-run-nixbot-gitlab> gitlab # [  307.298017] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:22.101Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"187b47eab3782cbeb7d455fc","created_at":"2026-06-17T14:57:21.701Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-5d7f9c1e07304c6b","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9edac7a0220507111c3692dd567f77ac9003c525e54c2d05163a5e0c4dbd3800","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:21.707Z","job_size_bytes":467,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-187b47eab3782cbeb7d455fc: start","job_status":"start","queue_duration_s":0.393448,"scheduling_latency_s":0.393484}1784vm-test-run-nixbot-gitlab> gitlab # [  307.314089] gitaly[1358]: time="2026-06-17T14:57:21.975Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=15 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1179 command.oublock=0 command.real_time_ms=36 command.spawn_token_fork_ms=7 command.system_time_ms=13 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-17T20:57:21.943" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:21.944" grpc.time_ms=30.726 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1785vm-test-run-nixbot-gitlab> gitlab # [  307.328505] gitaly[1358]: time="2026-06-17T14:57:22.077Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=594 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-06-17T14:57:52.062" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:22.062" grpc.time_ms=14.265 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1786vm-test-run-nixbot-gitlab> gitlab # [  307.340802] gitaly[1358]: time="2026-06-17T14:57:22.173Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:57:52.172" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:22.172" grpc.time_ms=0.911 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787vm-test-run-nixbot-gitlab> gitlab # [  307.352225] gitaly[1358]: time="2026-06-17T14:57:22.189Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-17T14:57:32.156" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:22.177" grpc.time_ms=12.166 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1788vm-test-run-nixbot-gitlab> gitlab # [  307.412088] gitaly[1358]: time="2026-06-17T14:57:22.343Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-17T14:57:52.341" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:22.341" grpc.time_ms=1.158 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1789vm-test-run-nixbot-gitlab> gitlab # [  307.426561] gitaly[1358]: time="2026-06-17T14:57:22.352Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=2 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=37 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-06-17T14:57:52.347" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:22.347" grpc.time_ms=4.555 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1790vm-test-run-nixbot-gitlab> gitlab # [  307.544577] gitaly[1358]: time="2026-06-17T14:57:22.475Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-17T14:57:32.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:22.458" grpc.time_ms=17.02 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1791vm-test-run-nixbot-gitlab> gitlab # [  307.626274] nixbot[3812]: INFO:     Started server process [3812]1792vm-test-run-nixbot-gitlab> gitlab # [  307.627990] nixbot[3812]: INFO:     Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1793vm-test-run-nixbot-gitlab> gitlab # [  307.632112] nixbot[3812]: INFO:     ::ffff:127.0.0.1:46588 - "GET /health HTTP/1.1" 200 OK1794vm-test-run-nixbot-gitlab> gitlab # [  307.639126] systemd[1]: Started nixbot CI service.1795vm-test-run-nixbot-gitlab> gitlab # [  307.640868] systemd[1]: Reached target Multi-User System.1796vm-test-run-nixbot-gitlab> gitlab # [  307.643229] systemd[1]: Startup finished in 877ms (kernel) + 6.082s (initrd) + 5min 682ms (userspace) = 5min 7.643s.1797vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit nixbot.service, in 1.12 seconds)1798vm-test-run-nixbot-gitlab> gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1799vm-test-run-nixbot-gitlab> gitlab # [  308.090937] nixbot[3812]: INFO:     ::ffff:127.0.0.1:46594 - "GET /health HTTP/1.1" 200 OK1800vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.06 seconds)1801vm-test-run-nixbot-gitlab> subtest: project discovered and webhook registered1802vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1803vm-test-run-nixbot-gitlab> gitlab # [  308.130916] gitaly[1358]: time="2026-06-17T14:57:23.062Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=20 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CFM3701P345WQAJT1E1F grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-17T14:57:53.037" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:23.038" grpc.time_ms=23.908 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1804vm-test-run-nixbot-gitlab> gitlab # [  308.175956] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:23 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 5421805vm-test-run-nixbot-gitlab> gitlab # [  308.180728] nixbot[3812]: {"ts": "2026-06-17T14:57:23.108Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1806vm-test-run-nixbot-gitlab> gitlab # [  308.205555] nixbot[3812]: {"ts": "2026-06-17T14:57:23.136Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1807vm-test-run-nixbot-gitlab> gitlab # [  308.305548] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 871808vm-test-run-nixbot-gitlab> gitlab # [  308.311190] nixbot[3812]: {"ts": "2026-06-17T14:57:23.241Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1809vm-test-run-nixbot-gitlab> gitlab # [  308.317309] nixbot[3812]: {"ts": "2026-06-17T14:57:23.243Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1810vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.30 seconds)1811vm-test-run-nixbot-gitlab> []1812vm-test-run-nixbot-gitlab> gitlab # [  308.391851] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:23 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.20.0" 2641813vm-test-run-nixbot-gitlab> gitlab # [  308.400768] gitaly[1358]: time="2026-06-17T14:57:23.332Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=4 command.system_time_ms=11 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-17T14:57:53.310" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:23.311" grpc.time_ms=20.713 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1814vm-test-run-nixbot-gitlab> gitlab # [  308.445560] gitaly[1358]: time="2026-06-17T14:57:23.376Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CCBS31GDGSR2YTCGKNC3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-06-17T14:57:53.360" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:23.360" grpc.time_ms=15.339 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1815vm-test-run-nixbot-gitlab> gitlab # [  308.463568] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:23 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 1421816vm-test-run-nixbot-gitlab> gitlab # [  308.466441] nixbot[3812]: {"ts": "2026-06-17T14:57:23.397Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1817vm-test-run-nixbot-gitlab> gitlab # [  308.534621] sidekiq-cluster[2420]: {"severity":"WARN","time":"2026-06-17T14:57:23.465Z","class":"CreatePipelineWorker","correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"3f5c5dc8ab8d0ef8b24eda2469b66ea53bab0658","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"3f5c5dc8ab8d0ef8b24eda2469b66ea53bab0658","ref":"refs/heads/master"},"retry":0}1818vm-test-run-nixbot-gitlab> gitlab # [  308.556228] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:23.486Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"187b47eab3782cbeb7d455fc","created_at":"2026-06-17T14:57:21.701Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-5d7f9c1e07304c6b","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9edac7a0220507111c3692dd567f77ac9003c525e54c2d05163a5e0c4dbd3800","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:21.707Z","job_size_bytes":467,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-187b47eab3782cbeb7d455fc: done: 1.385206 sec","job_status":"done","queue_duration_s":0.393448,"scheduling_latency_s":0.393484,"gitaly_calls":7,"gitaly_duration_s":0.125139,"redis_calls":53,"redis_duration_s":0.01836,"redis_read_bytes":171,"redis_write_bytes":4427,"redis_cache_calls":4,"redis_cache_duration_s":0.001724,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007393,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00216,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.003588,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003495,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":40,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":40,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.064,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.049,"db_ci_duration_s":0.015,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":1.14342,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00112654,"duration_s":1.385206,"completed_at":"2026-06-17T14:57:23.486Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.116247,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1819vm-test-run-nixbot-gitlab> gitlab # [  308.608372] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:23.490Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"06161316b564bf9b535acdee","created_at":"2026-06-17T14:57:21.892Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-153f4e6aaef64af2","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:21.897Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-06161316b564bf9b535acdee: start","job_status":"start","queue_duration_s":1.592781,"scheduling_latency_s":1.592831}1820vm-test-run-nixbot-gitlab> gitlab # [  308.670971] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:23.600Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"06161316b564bf9b535acdee","created_at":"2026-06-17T14:57:21.892Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-153f4e6aaef64af2","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:21.897Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-06161316b564bf9b535acdee: done: 0.110022 sec","job_status":"done","queue_duration_s":1.592781,"scheduling_latency_s":1.592831,"redis_calls":19,"redis_duration_s":0.00669,"redis_read_bytes":21,"redis_write_bytes":4290,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00183,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000841,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2261,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002787,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001232,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.080341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.017885480000000002,"duration_s":0.110022,"completed_at":"2026-06-17T14:57:23.600Z","load_balancing_strategy":"primary","db_duration_s":0.016497,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1821vm-test-run-nixbot-gitlab> gitlab # [  308.734060] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:23.604Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"74dbc74b89deaed846825cb4","created_at":"2026-06-17T14:57:23.571Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-fe9b68acc81741bd","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:23.582Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-74dbc74b89deaed846825cb4: start","job_status":"start","queue_duration_s":0.021586,"scheduling_latency_s":0.021618}1822vm-test-run-nixbot-gitlab> gitlab # [  308.822546] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:23.753Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"74dbc74b89deaed846825cb4","created_at":"2026-06-17T14:57:23.571Z","trace_propagation_headers":{"sentry-trace":"2725b2553f714a3aa29c1948d60b1745-fe9b68acc81741bd","baggage":"sentry-trace_id=2725b2553f714a3aa29c1948d60b1745,sentry-release=Unknown"},"correlation_id":"01KVB1CCBS31GDGSR2YTCGKNC3","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:23.582Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-74dbc74b89deaed846825cb4: done: 0.148973 sec","job_status":"done","queue_duration_s":0.021586,"scheduling_latency_s":0.021618,"redis_calls":11,"redis_duration_s":0.003943,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000798,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002486,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000659,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.011,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.106243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0005897,"duration_s":0.148973,"completed_at":"2026-06-17T14:57:23.753Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.037954,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1823vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1824vm-test-run-nixbot-gitlab> gitlab # [  309.516922] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:24 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 601825vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.13 seconds)1826vm-test-run-nixbot-gitlab> [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-06-17T14:57:23.377Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]1827vm-test-run-nixbot-gitlab> (finished: subtest: project discovered and webhook registered, in 1.42 seconds)1828vm-test-run-nixbot-gitlab> subtest: push delivers the webhook1829vm-test-run-nixbot-gitlab> gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1830vm-test-run-nixbot-gitlab> gitlab # [  309.667710] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:24 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 651831vm-test-run-nixbot-gitlab> gitlab # [  309.798796] gitaly[1358]: time="2026-06-17T14:57:24.725Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHKZDHA3A23JCGF94FP7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:24.713" grpc.time_ms=12.05 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1832vm-test-run-nixbot-gitlab> gitlab # Enumerating objects: 5, done.1833vm-test-run-nixbot-gitlab> gitlab # [  309.835591] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:24 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.54.0" 1201834vm-test-run-nixbot-gitlab> gitlab # Counting objects:  20% (1/5)Counting objects:  40% (2/5)Counting objects:  60% (3/5)Counting objects:  80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1835vm-test-run-nixbot-gitlab> gitlab # Delta compression using up to 4 threads1836vm-test-run-nixbot-gitlab> gitlab # Compressing objects:  50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1837vm-test-run-nixbot-gitlab> gitlab # Writing objects:  33% (1/3)Writing objects:  66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 273.00 KiB/s, done.1838vm-test-run-nixbot-gitlab> gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1839vm-test-run-nixbot-gitlab> gitlab # [  310.200901] gitaly[1358]: time="2026-06-17T14:57:25.132Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=592 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-06-17T14:57:35.001" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:25.113" grpc.time_ms=18.324 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1840vm-test-run-nixbot-gitlab> gitlab # [  310.377795] gitaly[1358]: time="2026-06-17T14:57:25.309Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=4 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-06-17T14:57:55.288" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-06-17T14:57:25.288" grpc.time_ms=20.11 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1841vm-test-run-nixbot-gitlab> gitlab # [  310.428155] gitaly[1358]: time="2026-06-17T14:57:25.359Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR duration_ms=368ns method=POST pid=1358 status=200 url="http://unix/api/v4/internal/allowed"1842vm-test-run-nixbot-gitlab> gitlab # [  310.494484] gitaly[1358]: time="2026-06-17T14:57:25.425Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR duration_ms=57ns method=POST pid=1358 status=200 url="http://unix/api/v4/internal/pre_receive"1843vm-test-run-nixbot-gitlab> gitlab # [  310.503307] gitaly[1358]: time="2026-06-17T14:57:25.426Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5318 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:24.989" grpc.time_ms=436.115 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1844vm-test-run-nixbot-gitlab> gitlab # [  310.554155] gitaly[1358]: time="2026-06-17T14:57:25.484Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4788 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:25.482" grpc.time_ms=2.061 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1845vm-test-run-nixbot-gitlab> gitlab # [  310.598510] gitaly[1358]: time="2026-06-17T14:57:25.529Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:25.529" grpc.time_ms=0.61 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1846vm-test-run-nixbot-gitlab> gitlab # [  310.640952] gitaly[1358]: time="2026-06-17T14:57:25.572Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4789 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:25.571" grpc.time_ms=0.645 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1847vm-test-run-nixbot-gitlab> gitlab # [  310.748762] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:25.678Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3f5c5dc8ab8d0ef8b24eda2469b66ea53bab0658 e1a496791a7f15c5bb7e99d876a15f5491f0ced5 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d5ed03264decf334bee46506","created_at":"2026-06-17T14:57:25.666Z","trace_propagation_headers":{"sentry-trace":"a0d50548e75740ef9739edb38548e8bc-21537c58ac234c9d","baggage":"sentry-trace_id=a0d50548e75740ef9739edb38548e8bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1CHSFQ7XPN7VTD17PD6PR","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:25.674Z","job_size_bytes":185,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d5ed03264decf334bee46506: start","job_status":"start","queue_duration_s":0.003668,"scheduling_latency_s":0.003712}1848vm-test-run-nixbot-gitlab> gitlab # [  310.780638] gitaly[1358]: time="2026-06-17T14:57:25.705Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR duration_ms=94ns method=POST pid=1358 status=200 url="http://unix/api/v4/internal/post_receive"1849vm-test-run-nixbot-gitlab> gitlab # [  310.787288] gitaly[1358]: time="2026-06-17T14:57:25.706Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4812 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:25.610" grpc.time_ms=95.332 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1850vm-test-run-nixbot-gitlab> gitlab # To http://gitlab/root/test-flake.git1851vm-test-run-nixbot-gitlab> gitlab #    3f5c5dc..e1a4967  [  310.808616] gitaly[1358]: time="2026-06-17T14:57:25.730Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR diskcache=396e5b13-9065-4b14-8605-c5e1ce55f347 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:24.889" pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1852vm-test-run-nixbot-gitlab> gitlab # master -> master[  310.824785] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:25.737Z","message":"changes: \"3f5c5dc8ab8d0ef8b24eda2469b66ea53bab0658 e1a496791a7f15c5bb7e99d876a15f5491f0ced5 refs/heads/master\\n\""}1853vm-test-run-nixbot-gitlab> gitlab # 1854vm-test-run-nixbot-gitlab> gitlab # [  310.828817] gitlab-workhorse[1290]: time="2026-06-17T14:57:25Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521855vm-test-run-nixbot-gitlab> gitlab # [  310.831769] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:25 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 9471856vm-test-run-nixbot-gitlab> gitlab # [  310.834674] gitaly[1358]: time="2026-06-17T14:57:25.730Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=249 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13259 command.oublock=32 command.real_time_ms=827 command.spawn_token_fork_ms=4 command.system_time_ms=172 command.user_time_ms=77 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:24.889" grpc.time_ms=841.186 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1857vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.34 seconds)1858vm-test-run-nixbot-gitlab> gitlab: must succeed: git -C /tmp/test-flake rev-parse master1859vm-test-run-nixbot-gitlab> gitlab # [  310.854135] gitaly[1358]: time="2026-06-17T14:57:25.769Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-17T14:57:35.006" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:25.756" grpc.time_ms=12.327 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1860vm-test-run-nixbot-gitlab> gitlab # [  310.870719] gitaly[1358]: time="2026-06-17T14:57:25.783Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-17T14:57:35.024" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:25.775" grpc.time_ms=8.281 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1861vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.03 seconds)1862vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1a496791a7f15c5bb7e99d876a15f5491f0ced5'1863vm-test-run-nixbot-gitlab> gitlab # [  310.886870] gitaly[1358]: time="2026-06-17T14:57:25.813Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=584 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-06-17T14:57:35.053" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:25.804" grpc.time_ms=9.232 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1864vm-test-run-nixbot-gitlab> gitlab # [  310.902033] gitaly[1358]: time="2026-06-17T14:57:25.825Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=597 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-06-17T14:57:55.817" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:25.817" grpc.time_ms=8.1 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1865vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1a496791a7f15c5bb7e99d876a15f5491f0ced5', in 0.04 seconds)1866vm-test-run-nixbot-gitlab> []1867vm-test-run-nixbot-gitlab> gitlab # [  310.917597] gitaly[1358]: time="2026-06-17T14:57:25.844Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=319 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-06-17T14:57:35.085" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-06-17T14:57:25.836" grpc.time_ms=8.025 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1868vm-test-run-nixbot-gitlab> gitlab # [  310.930801] nixbot[3812]: INFO:     ::ffff:127.0.0.1:36532 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1a496791a7f15c5bb7e99d876a15f5491f0ced5 HTTP/1.1" 200 OK1869vm-test-run-nixbot-gitlab> gitlab # [  310.933661] gitaly[1358]: time="2026-06-17T14:57:25.865Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=3 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-17T14:57:35.104" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:25.854" grpc.time_ms=10.706 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1870vm-test-run-nixbot-gitlab> gitlab # [  311.091609] redis[1257]: 10 changes in 300 seconds. Saving...1871vm-test-run-nixbot-gitlab> gitlab # [  311.093195] redis[1257]: Background saving started by pid 40181872vm-test-run-nixbot-gitlab> gitlab # [  311.101794] redis[4018]: BGSAVE done, 484 keys saved, 0 keys skipped, 121872 bytes written.1873vm-test-run-nixbot-gitlab> gitlab # [  311.108799] redis[4018]: DB saved on disk1874vm-test-run-nixbot-gitlab> gitlab # [  311.110168] redis[4018]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1875vm-test-run-nixbot-gitlab> gitlab # [  311.192242] redis[1257]: Background saving terminated with success1876vm-test-run-nixbot-gitlab> gitlab # [  311.510972] gitaly[1358]: time="2026-06-17T14:57:26.442Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-06-17T14:57:36.003" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:26.434" grpc.time_ms=7.852 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877vm-test-run-nixbot-gitlab> gitlab # [  311.609118] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:26.539Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","3f5c5dc8ab8d0ef8b24eda2469b66ea53bab0658 e1a496791a7f15c5bb7e99d876a15f5491f0ced5 refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"d5ed03264decf334bee46506","created_at":"2026-06-17T14:57:25.666Z","trace_propagation_headers":{"sentry-trace":"a0d50548e75740ef9739edb38548e8bc-21537c58ac234c9d","baggage":"sentry-trace_id=a0d50548e75740ef9739edb38548e8bc,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1CHSFQ7XPN7VTD17PD6PR","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-17T14:57:25.674Z","job_size_bytes":185,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-d5ed03264decf334bee46506: done: 0.861059 sec","job_status":"done","queue_duration_s":0.003668,"scheduling_latency_s":0.003712,"gitaly_calls":7,"gitaly_duration_s":0.086014,"redis_calls":112,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.051951000000000004,"redis_read_bytes":350,"redis_write_bytes":13069,"redis_cache_calls":9,"redis_cache_duration_s":0.001501,"redis_cache_read_bytes":14,"redis_cache_write_bytes":593,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.004538,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":323,"redis_queues_calls":8,"redis_queues_duration_s":0.004053,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6769,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.010689,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":41,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.007205,"redis_repository_cache_read_bytes":176,"redis_repository_cache_write_bytes":2193,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.023965,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":29,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":29,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.095,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":29,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.023,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.023,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.095,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.376809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00063256,"exclusive_lock_hold_duration_s":0.02301866,"duration_s":0.861059,"completed_at":"2026-06-17T14:57:26.538Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.309208,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1878vm-test-run-nixbot-gitlab> gitlab # [  311.705319] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:26.550Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"9f16fb3db1f18ed38eca5d6d","created_at":"2026-06-17T14:57:25.786Z","trace_propagation_headers":{"sentry-trace":"a0d50548e75740ef9739edb38548e8bc-2ca4e7a843e44cca","baggage":"sentry-trace_id=a0d50548e75740ef9739edb38548e8bc,sentry-release=Unknown"},"correlation_id":"01KVB1CHSFQ7XPN7VTD17PD6PR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:25.789Z","job_size_bytes":46,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9f16fb3db1f18ed38eca5d6d: start","job_status":"start","queue_duration_s":0.761093,"scheduling_latency_s":0.761144}1879vm-test-run-nixbot-gitlab> gitlab # [  311.725265] nixbot[3812]: {"ts": "2026-06-17T14:57:26.583Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1880vm-test-run-nixbot-gitlab> gitlab # [  311.728031] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:26 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 31691881vm-test-run-nixbot-gitlab> gitlab # [  311.746982] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:26.677Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"9f16fb3db1f18ed38eca5d6d","created_at":"2026-06-17T14:57:25.786Z","trace_propagation_headers":{"sentry-trace":"a0d50548e75740ef9739edb38548e8bc-2ca4e7a843e44cca","baggage":"sentry-trace_id=a0d50548e75740ef9739edb38548e8bc,sentry-release=Unknown"},"correlation_id":"01KVB1CHSFQ7XPN7VTD17PD6PR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:25.789Z","job_size_bytes":46,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9f16fb3db1f18ed38eca5d6d: done: 0.127055 sec","job_status":"done","queue_duration_s":0.761093,"scheduling_latency_s":0.761144,"redis_calls":9,"redis_duration_s":0.022689,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.013932,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.003362,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.005395,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033392,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.127055,"completed_at":"2026-06-17T14:57:26.677Z","load_balancing_strategy":"primary","db_duration_s":0.007374,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1882vm-test-run-nixbot-gitlab> gitlab # [  311.814620] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:26.733Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ecd47a9be0754628521171b3","created_at":"2026-06-17T14:57:25.797Z","trace_propagation_headers":{"sentry-trace":"a0d50548e75740ef9739edb38548e8bc-2ca4e7a843e44cca","baggage":"sentry-trace_id=a0d50548e75740ef9739edb38548e8bc,sentry-release=Unknown"},"correlation_id":"01KVB1CHSFQ7XPN7VTD17PD6PR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:25.799Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ecd47a9be0754628521171b3: start","job_status":"start","queue_duration_s":0.933689,"scheduling_latency_s":0.933743}1883vm-test-run-nixbot-gitlab> gitlab # [  311.832362] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:26 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 1561884vm-test-run-nixbot-gitlab> gitlab # [  311.834358] nixbot[3812]: {"ts": "2026-06-17T14:57:26.763Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1885vm-test-run-nixbot-gitlab> gitlab # [  311.907720] gitaly[1358]: time="2026-06-17T14:57:26.838Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR diskcache=bb4e8cbf-b2e9-4ba3-bb5d-997a5120d294 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-17T20:57:26.795" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:26.795" pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1886vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1a496791a7f15c5bb7e99d876a15f5491f0ced5'1887vm-test-run-nixbot-gitlab> gitlab # [  311.926357] gitaly[1358]: time="2026-06-17T14:57:26.838Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=27 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1513 command.oublock=0 command.real_time_ms=54 command.spawn_token_fork_ms=7 command.system_time_ms=18 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-17T20:57:26.795" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:26.795" grpc.time_ms=42.446 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1888vm-test-run-nixbot-gitlab> gitlab # [  311.948881] nixbot[3812]: {"ts": "2026-06-17T14:57:26.852Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1889vm-test-run-nixbot-gitlab> gitlab # [  311.951966] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:26 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 761890vm-test-run-nixbot-gitlab> gitlab # [  311.974643] nixbot[3812]: INFO:     ::ffff:127.0.0.1:36548 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1a496791a7f15c5bb7e99d876a15f5491f0ced5 HTTP/1.1" 200 OK1891vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1a496791a7f15c5bb7e99d876a15f5491f0ced5', in 0.05 seconds)1892vm-test-run-nixbot-gitlab> []1893vm-test-run-nixbot-gitlab> gitlab # [  311.988984] gitaly[1358]: time="2026-06-17T14:57:26.920Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CKT997AXNDB93256ANQQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-06-17T14:57:56.805" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=255 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:26.905" grpc.time_ms=14.312 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1894vm-test-run-nixbot-gitlab> gitlab # [  312.008560] gitaly[1358]: time="2026-06-17T14:57:26.936Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CKT997AXNDB93256ANQQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:57:56.832" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:26.934" grpc.time_ms=1.294 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1895vm-test-run-nixbot-gitlab> gitlab # [  312.022709] gitaly[1358]: time="2026-06-17T14:57:26.953Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=589 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CKT997AXNDB93256ANQQ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-06-17T14:57:36.229" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:26.939" grpc.time_ms=13.905 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1896vm-test-run-nixbot-gitlab> gitlab # [  312.036512] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:26.966Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"ecd47a9be0754628521171b3","created_at":"2026-06-17T14:57:25.797Z","trace_propagation_headers":{"sentry-trace":"a0d50548e75740ef9739edb38548e8bc-2ca4e7a843e44cca","baggage":"sentry-trace_id=a0d50548e75740ef9739edb38548e8bc,sentry-release=Unknown"},"correlation_id":"01KVB1CHSFQ7XPN7VTD17PD6PR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:25.799Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-ecd47a9be0754628521171b3: done: 0.235594 sec","job_status":"done","queue_duration_s":0.933689,"scheduling_latency_s":0.933743,"gitaly_calls":1,"gitaly_duration_s":0.048819,"redis_calls":12,"redis_duration_s":0.005959,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001696,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000663,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.0036,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.086,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.033,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.033,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.086,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.05156,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15157476,"duration_s":0.235594,"completed_at":"2026-06-17T14:57:26.965Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.137325,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1897vm-test-run-nixbot-gitlab> gitlab # [  312.078325] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:26.974Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"503af7be44c232b569151071","created_at":"2026-06-17T14:57:25.919Z","trace_propagation_headers":{"sentry-trace":"a0d50548e75740ef9739edb38548e8bc-2ca4e7a843e44cca","baggage":"sentry-trace_id=a0d50548e75740ef9739edb38548e8bc,sentry-release=Unknown"},"correlation_id":"01KVB1CHSFQ7XPN7VTD17PD6PR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:045c2ceb0a29f277129fdfce1fe26d0091981e8cddfd9dd011b30b2e292e5140","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:25.923Z","job_size_bytes":467,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-503af7be44c232b569151071: start","job_status":"start","queue_duration_s":1.050818,"scheduling_latency_s":1.050862}1898vm-test-run-nixbot-gitlab> gitlab # [  312.108336] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 771 "" "python-httpx/0.28.1" 1821899vm-test-run-nixbot-gitlab> gitlab # [  312.113109] nixbot[3812]: {"ts": "2026-06-17T14:57:27.044Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1900vm-test-run-nixbot-gitlab> gitlab # [  312.133519] gitaly[1358]: time="2026-06-17T14:57:27.064Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:57:57.062" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:27.063" grpc.time_ms=1.43 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1901vm-test-run-nixbot-gitlab> gitlab # [  312.158505] gitaly[1358]: time="2026-06-17T14:57:27.079Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-17T14:57:37.008" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:27.069" grpc.time_ms=10.23 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1902vm-test-run-nixbot-gitlab> gitlab # [  312.216979] gitaly[1358]: time="2026-06-17T14:57:27.148Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-17T14:57:57.146" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:27.146" grpc.time_ms=1.383 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1903vm-test-run-nixbot-gitlab> gitlab # [  312.251461] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:27 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1021904vm-test-run-nixbot-gitlab> gitlab # [  312.257467] nixbot[3812]: {"ts": "2026-06-17T14:57:27.151Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1905vm-test-run-nixbot-gitlab> gitlab # [  312.263508] nixbot[3812]: {"ts": "2026-06-17T14:57:27.156Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1906vm-test-run-nixbot-gitlab> gitlab # [  312.268815] gitaly[1358]: time="2026-06-17T14:57:27.184Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=21 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=21 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=296 command.oublock=0 command.real_time_ms=26 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-06-17T14:57:57.155" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:27.155" grpc.time_ms=28.25 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1907vm-test-run-nixbot-gitlab> gitlab # [  312.345006] gitaly[1358]: time="2026-06-17T14:57:27.276Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-17T14:57:37.204" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:27.264" grpc.time_ms=11.727 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1908vm-test-run-nixbot-gitlab> gitlab # [  312.369831] gitaly[1358]: time="2026-06-17T14:57:27.288Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=4 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CM5DF2TXCZ2BG07YBBVW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=198 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:27.277" grpc.time_ms=11.277 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc1909vm-test-run-nixbot-gitlab> gitlab # [  312.390203] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 751910vm-test-run-nixbot-gitlab> gitlab # [  312.433846] postgres[1333]: [1333] LOG:  checkpoint starting: time1911vm-test-run-nixbot-gitlab> gitlab # [  312.516970] gitaly[1358]: time="2026-06-17T14:57:27.448Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CM7TJ2N615R23BB3958N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:27.429" pid=1358 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1912vm-test-run-nixbot-gitlab> gitlab # [  312.545109] gitaly[1358]: time="2026-06-17T14:57:27.448Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CM7TJ2N615R23BB3958N grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:27.429" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc1913vm-test-run-nixbot-gitlab> gitlab # [  312.570446] gitlab-workhorse[1290]: time="2026-06-17T14:57:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491914vm-test-run-nixbot-gitlab> gitlab # [  312.573428] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:27 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 1581915vm-test-run-nixbot-gitlab> gitlab # [  312.576306] gitaly[1358]: time="2026-06-17T14:57:27.448Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CM7TJ2N615R23BB3958N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:27.429" grpc.time_ms=18.643 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc1916vm-test-run-nixbot-gitlab> gitlab # [  312.673268] gitaly[1358]: time="2026-06-17T14:57:27.604Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMCVYK5V9J3SW1ZKHGPE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:27.582" pid=1358 remote_ip="2001:db8:1::1" request_sha=1bdc2448b8be030fa6544cbd91eced06d7fef867 response_bytes=592 span.kind=server system=grpc1917vm-test-run-nixbot-gitlab> gitlab # [  312.693086] gitaly[1358]: time="2026-06-17T14:57:27.604Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1140 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMCVYK5V9J3SW1ZKHGPE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:27.582" negotiation.command=fetch negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc1918vm-test-run-nixbot-gitlab> gitlab # [  312.714746] gitlab-workhorse[1290]: time="2026-06-17T14:57:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=5921919vm-test-run-nixbot-gitlab> gitlab # [  312.717401] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:27 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 592 "" "git/2.54.0" 1541920vm-test-run-nixbot-gitlab> gitlab # [  312.719928] gitaly[1358]: time="2026-06-17T14:57:27.605Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=17 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1140 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=2 command.system_time_ms=15 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMCVYK5V9J3SW1ZKHGPE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=9 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:27.582" grpc.time_ms=22.246 negotiation.command=fetch negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc1921vm-test-run-nixbot-gitlab> gitlab # [  312.789497] gitaly[1358]: time="2026-06-17T14:57:27.717Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CMJTNC9KDWPNHK2TT7TP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:27.706" grpc.time_ms=11.872 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc1922vm-test-run-nixbot-gitlab> gitlab # [  312.810725] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:27 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 761923vm-test-run-nixbot-gitlab> gitlab # [  312.845935] gitaly[1358]: time="2026-06-17T14:57:27.777Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMN7DZH64XS4R48V65VX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:27.765" pid=1358 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1924vm-test-run-nixbot-gitlab> gitlab # [  312.863379] gitaly[1358]: time="2026-06-17T14:57:27.777Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMN7DZH64XS4R48V65VX grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:27.765" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc1925vm-test-run-nixbot-gitlab> gitlab # [  312.883781] gitlab-workhorse[1290]: time="2026-06-17T14:57:27Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671926vm-test-run-nixbot-gitlab> gitlab # [  312.886382] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:27 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 581927vm-test-run-nixbot-gitlab> gitlab # [  312.888852] gitaly[1358]: time="2026-06-17T14:57:27.777Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMN7DZH64XS4R48V65VX grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:27.765" grpc.time_ms=11.695 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc1928vm-test-run-nixbot-gitlab> gitlab # [  312.942397] gitaly[1358]: time="2026-06-17T14:57:27.872Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMR7QPSBGJQPHHPS7JZ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:57:57.770" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:27.871" grpc.time_ms=1.094 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1929vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1a496791a7f15c5bb7e99d876a15f5491f0ced5'1930vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=e1a496791a7f15c5bb7e99d876a15f5491f0ced5', in 0.05 seconds)1931vm-test-run-nixbot-gitlab> [{'id': 1, 'project_id': 1, 'number': 1, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': 'e1a496791a7f15c5bb7e99d876a15f5491f0ced5', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'pending', 'eval_warnings': None, 'error': None, 'created_at': '2026-06-17T14:57:27.805640Z', 'started_at': None, 'finished_at': None}]1932vm-test-run-nixbot-gitlab> (finished: subtest: push delivers the webhook, in 3.51 seconds)1933vm-test-run-nixbot-gitlab> subtest: eval and build post commit statuses1934vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses1935vm-test-run-nixbot-gitlab> gitlab # [  313.005471] gitaly[1358]: time="2026-06-17T14:57:27.936Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=593 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CMR7QPSBGJQPHHPS7JZ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-06-17T14:57:57.820" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:27.920" grpc.time_ms=15.766 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1936vm-test-run-nixbot-gitlab> gitlab # [  313.036449] gitaly[1358]: time="2026-06-17T14:57:27.956Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CMR7QPSBGJQPHHPS7JZ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-17T14:57:37.236" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:27.947" grpc.time_ms=8.668 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937vm-test-run-nixbot-gitlab> gitlab # [  313.058438] nixbot[3812]: INFO:     ::ffff:127.0.0.1:36550 - "GET /api/repos/gitlab/root/test-flake/builds?commit=e1a496791a7f15c5bb7e99d876a15f5491f0ced5 HTTP/1.1" 200 OK1938vm-test-run-nixbot-gitlab> gitlab # [  313.104904] gitaly[1358]: time="2026-06-17T14:57:28.036Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMR7QPSBGJQPHHPS7JZ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-17T14:57:38.005" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:28.036" grpc.time_ms=0.303 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1939vm-test-run-nixbot-gitlab> gitlab # [  313.134030] gitaly[1358]: time="2026-06-17T14:57:28.065Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMR7QPSBGJQPHHPS7JZ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-17T14:57:38.025" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:28.056" grpc.time_ms=8.372 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1940vm-test-run-nixbot-gitlab> gitlab # [  313.148064] gitaly[1358]: time="2026-06-17T14:57:28.068Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMXEQVA665ZSZWD1GYFN grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:57:58.066" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:28.066" grpc.time_ms=1.312 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1941vm-test-run-nixbot-gitlab> gitlab # [  313.200158] gitaly[1358]: time="2026-06-17T14:57:28.129Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CMR7QPSBGJQPHHPS7JZ0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:28.128" grpc.time_ms=0.587 pid=1358 span.kind=server system=grpc1942vm-test-run-nixbot-gitlab> gitlab # [  313.212853] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:28 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses HTTP/1.1" 200 2 "" "curl/8.20.0" 1611943vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses, in 0.19 seconds)1944vm-test-run-nixbot-gitlab> []1945vm-test-run-nixbot-gitlab> gitlab # [  313.229527] gitaly[1358]: time="2026-06-17T14:57:28.161Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CMR7QPSBGJQPHHPS7JZ0 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4157 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:28.160" grpc.time_ms=0.476 pid=1358 span.kind=server system=grpc1946vm-test-run-nixbot-gitlab> gitlab # [  313.243623] gitaly[1358]: time="2026-06-17T14:57:28.170Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMR7QPSBGJQPHHPS7JZ0 diskcache=20eb13a4-43db-4eed-967f-23e21c36cde9 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-17T14:57:38.038" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:28.068" pid=1358 ref=refs/keep-around/e1a496791a7f15c5bb7e99d876a15f5491f0ced5 remote_ip="2001:db8:1::1" revision=e1a496791a7f15c5bb7e99d876a15f5491f0ced5 span.kind=server system=grpc username=root1947vm-test-run-nixbot-gitlab> gitlab # [  313.257525] gitaly[1358]: time="2026-06-17T14:57:28.174Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=84 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5254 command.oublock=8 command.real_time_ms=94 command.spawn_token_fork_ms=0 command.system_time_ms=55 command.user_time_ms=29 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMR7QPSBGJQPHHPS7JZ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-17T14:57:38.038" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-17T14:57:28.068" grpc.time_ms=105.826 pid=1358 ref=refs/keep-around/e1a496791a7f15c5bb7e99d876a15f5491f0ced5 remote_ip="2001:db8:1::1" revision=e1a496791a7f15c5bb7e99d876a15f5491f0ced5 span.kind=server system=grpc username=root1948vm-test-run-nixbot-gitlab> gitlab # [  313.273728] gitaly[1358]: time="2026-06-17T14:57:28.179Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMR7QPSBGJQPHHPS7JZ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:57:58.078" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:28.179" grpc.time_ms=0.298 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1949vm-test-run-nixbot-gitlab> gitlab # [  313.286284] gitaly[1358]: time="2026-06-17T14:57:28.211Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=883 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=0 command.system_time_ms=3 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-17T14:57:58.197" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:28.197" grpc.time_ms=14.441 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1950vm-test-run-nixbot-gitlab> gitlab # [  313.300769] gitaly[1358]: time="2026-06-17T14:57:28.230Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=0 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CHSFQ7XPN7VTD17PD6PR grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-06-17T14:57:58.217" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:28.217" grpc.time_ms=12.577 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1951vm-test-run-nixbot-gitlab> gitlab # [  313.331038] sidekiq-cluster[2420]: {"severity":"WARN","time":"2026-06-17T14:57:28.260Z","class":"CreatePipelineWorker","correlation_id":"01KVB1CHSFQ7XPN7VTD17PD6PR","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"3f5c5dc8ab8d0ef8b24eda2469b66ea53bab0658","after":"e1a496791a7f15c5bb7e99d876a15f5491f0ced5","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"e1a496791a7f15c5bb7e99d876a15f5491f0ced5","ref":"refs/heads/master"},"retry":0}1952vm-test-run-nixbot-gitlab> gitlab # [  313.342412] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:28.272Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"503af7be44c232b569151071","created_at":"2026-06-17T14:57:25.919Z","trace_propagation_headers":{"sentry-trace":"a0d50548e75740ef9739edb38548e8bc-2ca4e7a843e44cca","baggage":"sentry-trace_id=a0d50548e75740ef9739edb38548e8bc,sentry-release=Unknown"},"correlation_id":"01KVB1CHSFQ7XPN7VTD17PD6PR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:045c2ceb0a29f277129fdfce1fe26d0091981e8cddfd9dd011b30b2e292e5140","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:25.923Z","job_size_bytes":467,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-503af7be44c232b569151071: done: 1.298201 sec","job_status":"done","queue_duration_s":1.050818,"scheduling_latency_s":1.050862,"gitaly_calls":7,"gitaly_duration_s":0.18561,"redis_calls":33,"redis_duration_s":0.021158,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.000436,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.012049,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.005446,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.003227,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.094,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.08,"db_ci_duration_s":0.014,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.882461,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.298201,"completed_at":"2026-06-17T14:57:28.272Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.093664,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1953vm-test-run-nixbot-gitlab> gitlab # [  313.387616] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:28.275Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"c9b96953-44b5-48a2-b9de-0eced39f32aa\"}"],"class":"WebHookWorker","jid":"9f821e34cfd85cd0b26b7d37","created_at":"2026-06-17T14:57:26.332Z","trace_propagation_headers":{"sentry-trace":"a0d50548e75740ef9739edb38548e8bc-2ca4e7a843e44cca","baggage":"sentry-trace_id=a0d50548e75740ef9739edb38548e8bc,sentry-release=Unknown"},"correlation_id":"01KVB1CHSFQ7XPN7VTD17PD6PR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:22f94515b8df405bedf1defc74af8ea86de0474a0a1dd418cfcdfb71c81f75e5","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:26.352Z","job_size_bytes":1749,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-9f821e34cfd85cd0b26b7d37: start","job_status":"start","queue_duration_s":1.923455,"scheduling_latency_s":1.923484}1954vm-test-run-nixbot-gitlab> gitlab # [  313.463201] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:28 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e1a496791a7f15c5bb7e99d876a15f5491f0ced5 HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 5781955vm-test-run-nixbot-gitlab> gitlab # [  313.471059] nixbot[3812]: {"ts": "2026-06-17T14:57:28.395Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e1a496791a7f15c5bb7e99d876a15f5491f0ced5 \"HTTP/1.1 201 Created\""}1956vm-test-run-nixbot-gitlab> gitlab # [  313.478933] nixbot[3812]: {"ts": "2026-06-17T14:57:28.403Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-e1a496791a7f-545fef1c", "argv0": "bwrap"}1957vm-test-run-nixbot-gitlab> gitlab # [  313.592729] systemd[1]: Started Nix Daemon.1958vm-test-run-nixbot-gitlab> gitlab # [  313.687329] nix-daemon[4127]: accepted connection from pid 4125, user nixbot1959vm-test-run-nixbot-gitlab> gitlab # [  313.693225] nix-daemon[4127]: accepted connection from pid 4126, user nixbot1960vm-test-run-nixbot-gitlab> gitlab # [  313.775193] nixbot[3812]: INFO:     ::ffff:127.0.0.1:36560 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1961vm-test-run-nixbot-gitlab> gitlab # [  313.827532] gitaly[1358]: time="2026-06-17T14:57:28.758Z" level=info msg="burden monitor stats" pid=1358 top_10_by_cpu="[]" top_10_by_memory="[]"1962vm-test-run-nixbot-gitlab> gitlab # [  313.857015] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:28.787Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"c9b96953-44b5-48a2-b9de-0eced39f32aa\"}"],"class":"WebHookWorker","jid":"9f821e34cfd85cd0b26b7d37","created_at":"2026-06-17T14:57:26.332Z","trace_propagation_headers":{"sentry-trace":"a0d50548e75740ef9739edb38548e8bc-2ca4e7a843e44cca","baggage":"sentry-trace_id=a0d50548e75740ef9739edb38548e8bc,sentry-release=Unknown"},"correlation_id":"01KVB1CHSFQ7XPN7VTD17PD6PR","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:22f94515b8df405bedf1defc74af8ea86de0474a0a1dd418cfcdfb71c81f75e5","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:26.352Z","job_size_bytes":1749,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-9f821e34cfd85cd0b26b7d37: done: 0.511479 sec","job_status":"done","queue_duration_s":1.923455,"scheduling_latency_s":1.923484,"redis_calls":19,"redis_duration_s":0.035567999999999995,"redis_read_bytes":31,"redis_write_bytes":5281,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.011642,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.003426,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3643,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.014556,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.005944,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.02217761999997947,"cpu_s":0.139192,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0033976,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.511479,"completed_at":"2026-06-17T14:57:28.786Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.011733,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1963vm-test-run-nixbot-gitlab> gitlab # [  313.933353] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:28.801Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3cbafb815cde124dd55c5de8","created_at":"2026-06-17T14:57:28.189Z","trace_propagation_headers":{"sentry-trace":"09602c4644944aabaa6ad05615cbdc62-ac76a83fae6242fd","baggage":"sentry-trace_id=09602c4644944aabaa6ad05615cbdc62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1CMR7QPSBGJQPHHPS7JZ0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:28.208Z","job_size_bytes":65,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3cbafb815cde124dd55c5de8: start","job_status":"start","queue_duration_s":0.592258,"scheduling_latency_s":0.592315}1964vm-test-run-nixbot-gitlab> gitlab # [  314.119894] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:29.050Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"3cbafb815cde124dd55c5de8","created_at":"2026-06-17T14:57:28.189Z","trace_propagation_headers":{"sentry-trace":"09602c4644944aabaa6ad05615cbdc62-ac76a83fae6242fd","baggage":"sentry-trace_id=09602c4644944aabaa6ad05615cbdc62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1CMR7QPSBGJQPHHPS7JZ0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:28.208Z","job_size_bytes":65,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-3cbafb815cde124dd55c5de8: done: 0.24889 sec","job_status":"done","queue_duration_s":0.592258,"scheduling_latency_s":0.592315,"redis_calls":18,"redis_duration_s":0.041817,"redis_read_bytes":271,"redis_write_bytes":2103,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.02388,"redis_feature_flag_read_bytes":264,"redis_feature_flag_write_bytes":1285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.012312,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005625,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.03,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.103974,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00340318,"duration_s":0.24889,"completed_at":"2026-06-17T14:57:29.049Z","load_balancing_strategy":"primary","db_duration_s":0.045306,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1965vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses1966vm-test-run-nixbot-gitlab> gitlab # [  314.211547] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:29.062Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ae28556d5a1c5061c387e4b5","created_at":"2026-06-17T14:57:28.211Z","trace_propagation_headers":{"sentry-trace":"09602c4644944aabaa6ad05615cbdc62-ac76a83fae6242fd","baggage":"sentry-trace_id=09602c4644944aabaa6ad05615cbdc62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1CMR7QPSBGJQPHHPS7JZ0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:28.218Z","job_size_bytes":65,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ae28556d5a1c5061c387e4b5: start","job_status":"start","queue_duration_s":0.843649,"scheduling_latency_s":0.843697}1967vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses, in 0.35 seconds)1968vm-test-run-nixbot-gitlab> [{'id': 1, 'sha': 'e1a496791a7f15c5bb7e99d876a15f5491f0ced5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-06-17T14:57:28.354Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1969vm-test-run-nixbot-gitlab> gitlab # [  314.507178] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:29.435Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"ae28556d5a1c5061c387e4b5","created_at":"2026-06-17T14:57:28.211Z","trace_propagation_headers":{"sentry-trace":"09602c4644944aabaa6ad05615cbdc62-ac76a83fae6242fd","baggage":"sentry-trace_id=09602c4644944aabaa6ad05615cbdc62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1CMR7QPSBGJQPHHPS7JZ0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:28.218Z","job_size_bytes":65,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-ae28556d5a1c5061c387e4b5: done: 0.373581 sec","job_status":"done","queue_duration_s":0.843649,"scheduling_latency_s":0.843697,"redis_calls":21,"redis_duration_s":0.046106,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.016745,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.016542,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.012819,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.128,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.104,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.137766,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00363028,"duration_s":0.373581,"completed_at":"2026-06-17T14:57:29.435Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.13806,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1970vm-test-run-nixbot-gitlab> gitlab # [  314.597785] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:29.444Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"68d0a138a08be07d6238a89f","created_at":"2026-06-17T14:57:28.363Z","trace_propagation_headers":{"sentry-trace":"09602c4644944aabaa6ad05615cbdc62-ac76a83fae6242fd","baggage":"sentry-trace_id=09602c4644944aabaa6ad05615cbdc62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1CMR7QPSBGJQPHHPS7JZ0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:28.370Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-68d0a138a08be07d6238a89f: start","job_status":"start","queue_duration_s":1.074004,"scheduling_latency_s":1.074055}1971vm-test-run-nixbot-gitlab> gitlab # [  314.621133] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:29 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 2871972vm-test-run-nixbot-gitlab> gitlab # [  314.625059] gitaly[1358]: time="2026-06-17T14:57:29.463Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CP3XQ4HQFN19EYRQ0R6N grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:57:59.361" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:29.461" grpc.time_ms=1.304 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973vm-test-run-nixbot-gitlab> gitlab # [  314.879116] gitaly[1358]: time="2026-06-17T14:57:29.810Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CMR7QPSBGJQPHHPS7JZ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-17T14:57:59.808" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:29.808" grpc.time_ms=1.67 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1974vm-test-run-nixbot-gitlab> gitlab # [  315.013337] gitaly[1358]: time="2026-06-17T14:57:29.944Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMR7QPSBGJQPHHPS7JZ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:57:59.042" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:29.943" grpc.time_ms=1.402 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975vm-test-run-nixbot-gitlab> gitlab # [  315.110938] gitaly[1358]: time="2026-06-17T14:57:30.042Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CMR7QPSBGJQPHHPS7JZ0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:58:00.040" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:30.040" grpc.time_ms=1.411 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1976vm-test-run-nixbot-gitlab> gitlab # [  315.178322] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:30.108Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"68d0a138a08be07d6238a89f","created_at":"2026-06-17T14:57:28.363Z","trace_propagation_headers":{"sentry-trace":"09602c4644944aabaa6ad05615cbdc62-ac76a83fae6242fd","baggage":"sentry-trace_id=09602c4644944aabaa6ad05615cbdc62,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1CMR7QPSBGJQPHHPS7JZ0","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:28.370Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-68d0a138a08be07d6238a89f: done: 0.663848 sec","job_status":"done","queue_duration_s":1.074004,"scheduling_latency_s":1.074055,"gitaly_calls":3,"gitaly_duration_s":0.029511,"redis_calls":53,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.097441,"redis_read_bytes":235,"redis_write_bytes":7159,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.012015,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.015822,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.014676,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":2,"redis_queues_duration_s":0.00143,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.017026,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.010093,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.006536,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.007828,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.143,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.01,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.02,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.08,"db_ci_duration_s":0.064,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.361668,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.51654694,"duration_s":0.663848,"completed_at":"2026-06-17T14:57:30.108Z","load_balancing_strategy":"primary","db_duration_s":0.167554,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1977vm-test-run-nixbot-gitlab> gitlab # [  315.276764] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:30.122Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","9f821e34cfd85cd0b26b7d37"],"class":"WebHooks::LogExecutionWorker","jid":"17c15b9872e036c09c0800de","created_at":"2026-06-17T14:57:28.722Z","trace_propagation_headers":{"sentry-trace":"a0d50548e75740ef9739edb38548e8bc-80e9e90c69484dd4","baggage":"sentry-trace_id=a0d50548e75740ef9739edb38548e8bc,sentry-release=Unknown"},"correlation_id":"01KVB1CHSFQ7XPN7VTD17PD6PR","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bfbb09a3ea92370353a1232823c1532c737551db6995632d70365e55ec51b8fd","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:28.739Z","job_size_bytes":2506,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-17c15b9872e036c09c0800de: start","job_status":"start","queue_duration_s":1.382909,"scheduling_latency_s":1.382957}1978vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses1979vm-test-run-nixbot-gitlab> gitlab # [  315.541271] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:30.470Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","9f821e34cfd85cd0b26b7d37"],"class":"WebHooks::LogExecutionWorker","jid":"17c15b9872e036c09c0800de","created_at":"2026-06-17T14:57:28.722Z","trace_propagation_headers":{"sentry-trace":"a0d50548e75740ef9739edb38548e8bc-80e9e90c69484dd4","baggage":"sentry-trace_id=a0d50548e75740ef9739edb38548e8bc,sentry-release=Unknown"},"correlation_id":"01KVB1CHSFQ7XPN7VTD17PD6PR","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bfbb09a3ea92370353a1232823c1532c737551db6995632d70365e55ec51b8fd","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:28.739Z","job_size_bytes":2506,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-17c15b9872e036c09c0800de: done: 0.348481 sec","job_status":"done","queue_duration_s":1.382909,"scheduling_latency_s":1.382957,"redis_calls":10,"redis_duration_s":0.026915,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.006889,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.014268,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005758,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.09,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.09,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.232405,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0013918,"duration_s":0.348481,"completed_at":"2026-06-17T14:57:30.470Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.031827,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1980vm-test-run-nixbot-gitlab> gitlab # [  315.646630] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:30.483Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"afe2306b5ccd8e7b69711272","created_at":"2026-06-17T14:57:29.733Z","trace_propagation_headers":{"sentry-trace":"09602c4644944aabaa6ad05615cbdc62-48d5c81dc08144d6","baggage":"sentry-trace_id=09602c4644944aabaa6ad05615cbdc62,sentry-release=Unknown"},"correlation_id":"01KVB1CMR7QPSBGJQPHHPS7JZ0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:29.757Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-afe2306b5ccd8e7b69711272: start","job_status":"start","queue_duration_s":0.725556,"scheduling_latency_s":0.725599}1981vm-test-run-nixbot-gitlab> gitlab # [  315.737548] gitaly[1358]: time="2026-06-17T14:57:30.667Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CQE4P55WM0YP8BCX2YNA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:58:00.564" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:30.665" grpc.time_ms=1.279 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses, in 0.21 seconds)1983vm-test-run-nixbot-gitlab> [{'id': 1, 'sha': 'e1a496791a7f15c5bb7e99d876a15f5491f0ced5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-06-17T14:57:28.354Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1984vm-test-run-nixbot-gitlab> gitlab # [  315.782604] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:30 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1471985vm-test-run-nixbot-gitlab> gitlab # [  315.969207] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:30.899Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"afe2306b5ccd8e7b69711272","created_at":"2026-06-17T14:57:29.733Z","trace_propagation_headers":{"sentry-trace":"09602c4644944aabaa6ad05615cbdc62-48d5c81dc08144d6","baggage":"sentry-trace_id=09602c4644944aabaa6ad05615cbdc62,sentry-release=Unknown"},"correlation_id":"01KVB1CMR7QPSBGJQPHHPS7JZ0","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:29.757Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-afe2306b5ccd8e7b69711272: done: 0.416474 sec","job_status":"done","queue_duration_s":0.725556,"scheduling_latency_s":0.725599,"redis_calls":10,"redis_duration_s":0.012461999999999999,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003284,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.005912,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003266,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.209,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.202,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0031019,"duration_s":0.416474,"completed_at":"2026-06-17T14:57:30.899Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.208763,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1986vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses1987vm-test-run-nixbot-gitlab> gitlab # [  316.954576] gitaly[1358]: time="2026-06-17T14:57:31.884Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CRKWYGXY07X5EX724W4P grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:58:01.782" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:31.883" grpc.time_ms=1.369 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1988vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses, in 0.22 seconds)1989vm-test-run-nixbot-gitlab> [{'id': 1, 'sha': 'e1a496791a7f15c5bb7e99d876a15f5491f0ced5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-06-17T14:57:28.354Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1990vm-test-run-nixbot-gitlab> gitlab # [  317.007505] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:31 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1651991vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses1992vm-test-run-nixbot-gitlab> gitlab # [  318.071302] gitaly[1358]: time="2026-06-17T14:57:33.001Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CSP259Z5WPQBXYDB8VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:58:02.098" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:32.999" grpc.time_ms=1.443 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1993vm-test-run-nixbot-gitlab> gitlab # [  318.177260] gitaly[1358]: time="2026-06-17T14:57:33.108Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CST1E0KNM2P0W994XDNZ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:58:03.006" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:33.107" grpc.time_ms=1.153 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1994vm-test-run-nixbot-gitlab> gitlab # [  318.217013] gitaly[1358]: time="2026-06-17T14:57:33.148Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CSP259Z5WPQBXYDB8VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-17T14:57:43.024" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:33.135" grpc.time_ms=12.682 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1995vm-test-run-nixbot-gitlab> gitlab # [  318.239708] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:33 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1741996vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses, in 0.23 seconds)1997vm-test-run-nixbot-gitlab> [{'id': 1, 'sha': 'e1a496791a7f15c5bb7e99d876a15f5491f0ced5', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-06-17T14:57:28.354Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1998vm-test-run-nixbot-gitlab> gitlab # [  318.369913] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:33.299Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"052175cc0a99d5e2c1cf91f0","created_at":"2026-06-17T14:57:33.288Z","trace_propagation_headers":{"sentry-trace":"cfe3c0cc37744c5fb18b7242c022107c-8e8ac85f30894413","baggage":"sentry-trace_id=cfe3c0cc37744c5fb18b7242c022107c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1CSP259Z5WPQBXYDB8VVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:33.296Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-052175cc0a99d5e2c1cf91f0: start","job_status":"start","queue_duration_s":0.002748,"scheduling_latency_s":0.002816}1999vm-test-run-nixbot-gitlab> gitlab # [  318.413328] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e1a496791a7f15c5bb7e99d876a15f5491f0ced5 HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 4652000vm-test-run-nixbot-gitlab> gitlab # [  318.420154] nixbot[3812]: {"ts": "2026-06-17T14:57:33.334Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e1a496791a7f15c5bb7e99d876a15f5491f0ced5 \"HTTP/1.1 201 Created\""}2001vm-test-run-nixbot-gitlab> gitlab # [  318.507086] gitaly[1358]: time="2026-06-17T14:57:33.438Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CT4X3ER41D2ASY2GP3GP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:58:03.436" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:33.436" grpc.time_ms=1.319 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2002vm-test-run-nixbot-gitlab> gitlab # [  318.581338] gitaly[1358]: time="2026-06-17T14:57:33.512Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CT4X3ER41D2ASY2GP3GP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-17T14:57:43.107" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:33.497" grpc.time_ms=14.996 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2003vm-test-run-nixbot-gitlab> gitlab # [  318.627806] gitaly[1358]: time="2026-06-17T14:57:33.559Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CSP259Z5WPQBXYDB8VVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:33.558" grpc.time_ms=0.484 pid=1358 span.kind=server system=grpc2004vm-test-run-nixbot-gitlab> gitlab # [  318.654193] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e1a496791a7f15c5bb7e99d876a15f5491f0ced5 HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2422005vm-test-run-nixbot-gitlab> gitlab # [  318.659901] nixbot[3812]: {"ts": "2026-06-17T14:57:33.585Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e1a496791a7f15c5bb7e99d876a15f5491f0ced5 \"HTTP/1.1 201 Created\""}2006vm-test-run-nixbot-gitlab> gitlab # [  318.668889] gitaly[1358]: time="2026-06-17T14:57:33.600Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CSP259Z5WPQBXYDB8VVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:33.599" grpc.time_ms=0.782 pid=1358 span.kind=server system=grpc2007vm-test-run-nixbot-gitlab> gitlab # [  318.716431] gitaly[1358]: time="2026-06-17T14:57:33.647Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KVB1CSP259Z5WPQBXYDB8VVP grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-17T14:57:33.647" grpc.time_ms=0.749 pid=1358 span.kind=server system=grpc2008vm-test-run-nixbot-gitlab> gitlab # [  318.731808] gitaly[1358]: time="2026-06-17T14:57:33.661Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CTD233B1BAC4NP69ZQX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:58:03.658" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:33.659" grpc.time_ms=1 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2009vm-test-run-nixbot-gitlab> gitlab # [  318.751724] gitaly[1358]: time="2026-06-17T14:57:33.666Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CSP259Z5WPQBXYDB8VVP diskcache=871a8901-fa36-4e85-9db5-3fc61cce761b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-17T14:58:03.502" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:33.503" pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2010vm-test-run-nixbot-gitlab> gitlab # [  318.765638] gitaly[1358]: time="2026-06-17T14:57:33.667Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=147 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=7050 command.oublock=0 command.real_time_ms=152 command.spawn_token_fork_ms=0 command.system_time_ms=80 command.user_time_ms=67 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CSP259Z5WPQBXYDB8VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-17T14:58:03.502" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:33.503" grpc.time_ms=163.09 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2011vm-test-run-nixbot-gitlab> gitlab # [  318.808415] gitaly[1358]: time="2026-06-17T14:57:33.739Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CTD233B1BAC4NP69ZQX4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-17T14:57:43.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-17T14:57:33.723" grpc.time_ms=16.323 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2012vm-test-run-nixbot-gitlab> gitlab # [  318.886639] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:33 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/e1a496791a7f15c5bb7e99d876a15f5491f0ced5 HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2152013vm-test-run-nixbot-gitlab> gitlab # [  318.894475] nixbot[3812]: {"ts": "2026-06-17T14:57:33.819Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/e1a496791a7f15c5bb7e99d876a15f5491f0ced5 \"HTTP/1.1 201 Created\""}2014vm-test-run-nixbot-gitlab> gitlab # [  319.132884] gitaly[1358]: time="2026-06-17T14:57:34.063Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CSP259Z5WPQBXYDB8VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-17T14:58:04.061" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:34.062" grpc.time_ms=1.377 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2015vm-test-run-nixbot-gitlab> gitlab # [  319.187355] gitaly[1358]: time="2026-06-17T14:57:34.118Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CSP259Z5WPQBXYDB8VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:58:04.117" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:34.117" grpc.time_ms=1.141 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2016vm-test-run-nixbot-gitlab> gitlab # [  319.220197] nix-daemon[4127]: accepted connection from pid 4203, user nixbot2017vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses2018vm-test-run-nixbot-gitlab> gitlab # [  319.288101] gitaly[1358]: time="2026-06-17T14:57:34.216Z" level=info msg="finished unary call with code OK" catfile.duration_ms=1 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=1 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CSP259Z5WPQBXYDB8VVP grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:58:04.214" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:34.214" grpc.time_ms=1.72 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2019vm-test-run-nixbot-gitlab> gitlab # [  319.312860] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:34.243Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"46a5009ab10a85103ac5e970","created_at":"2026-06-17T14:57:34.236Z","trace_propagation_headers":{"sentry-trace":"cfe3c0cc37744c5fb18b7242c022107c-fae1285313174255","baggage":"sentry-trace_id=cfe3c0cc37744c5fb18b7242c022107c,sentry-release=Unknown"},"correlation_id":"01KVB1CSP259Z5WPQBXYDB8VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"052175cc0a99d5e2c1cf91f0","job_size_bytes":3,"pid":2420,"job_status":"deduplicated","message":"PipelineProcessWorker JID-46a5009ab10a85103ac5e970: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2020vm-test-run-nixbot-gitlab> gitlab # [  319.339647] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:34.247Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"052175cc0a99d5e2c1cf91f0","created_at":"2026-06-17T14:57:33.288Z","trace_propagation_headers":{"sentry-trace":"cfe3c0cc37744c5fb18b7242c022107c-8e8ac85f30894413","baggage":"sentry-trace_id=cfe3c0cc37744c5fb18b7242c022107c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1CSP259Z5WPQBXYDB8VVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:33.296Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2420,"job_status":"rescheduled","message":"PipelineProcessWorker JID-052175cc0a99d5e2c1cf91f0: rescheduled"}2021vm-test-run-nixbot-gitlab> gitlab # [  319.355153] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:34.260Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"052175cc0a99d5e2c1cf91f0","created_at":"2026-06-17T14:57:33.288Z","trace_propagation_headers":{"sentry-trace":"cfe3c0cc37744c5fb18b7242c022107c-8e8ac85f30894413","baggage":"sentry-trace_id=cfe3c0cc37744c5fb18b7242c022107c,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KVB1CSP259Z5WPQBXYDB8VVP","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:33.296Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-052175cc0a99d5e2c1cf91f0: done: 0.961804 sec","job_status":"done","queue_duration_s":0.002748,"scheduling_latency_s":0.002816,"gitaly_calls":4,"gitaly_duration_s":0.181856,"redis_calls":116,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.326716,"redis_read_bytes":280,"redis_write_bytes":27322,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.002697,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.004281,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_feature_flag_calls":26,"redis_feature_flag_duration_s":0.008849,"redis_feature_flag_read_bytes":26,"redis_feature_flag_write_bytes":4583,"redis_queues_calls":25,"redis_queues_duration_s":0.005184,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14466,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.008001,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000557,"redis_rate_limiting_read_bytes":1,"redis_rate_limiting_write_bytes":81,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000767,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.293683,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":851,"db_count":49,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":49,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.095,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.033,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.037,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.052,"db_ci_duration_s":0.043,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.382496,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.88258862,"duration_s":0.961804,"completed_at":"2026-06-17T14:57:34.260Z","load_balancing_strategy":"primary","db_duration_s":0.099513,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2022vm-test-run-nixbot-gitlab> gitlab # [  319.405352] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:34.264Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"94f50d8c638b9186802ceb98","created_at":"2026-06-17T14:57:33.466Z","trace_propagation_headers":{"sentry-trace":"cfe3c0cc37744c5fb18b7242c022107c-fae1285313174255","baggage":"sentry-trace_id=cfe3c0cc37744c5fb18b7242c022107c,sentry-release=Unknown"},"correlation_id":"01KVB1CSP259Z5WPQBXYDB8VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:33.477Z","job_size_bytes":23,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-94f50d8c638b9186802ceb98: start","job_status":"start","queue_duration_s":0.786977,"scheduling_latency_s":0.787014}2023vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses, in 0.19 seconds)2024vm-test-run-nixbot-gitlab> [{'id': 1, 'sha': 'e1a496791a7f15c5bb7e99d876a15f5491f0ced5', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-06-17T14:57:28.354Z', 'started_at': None, 'finished_at': '2026-06-17T14:57:33.269Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': 'e1a496791a7f15c5bb7e99d876a15f5491f0ced5', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': '0 attributes built', 'created_at': '2026-06-17T14:57:33.548Z', 'started_at': None, 'finished_at': '2026-06-17T14:57:33.777Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2025vm-test-run-nixbot-gitlab> gitlab # [  319.420916] gitaly[1358]: time="2026-06-17T14:57:34.295Z" level=info msg="finished unary call with code OK" catfile.duration_ms=3 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=3 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KVB1CV0HYQB58N3XFFJH2R88 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-17T14:58:04.291" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-17T14:57:34.292" grpc.time_ms=3.598 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2026vm-test-run-nixbot-gitlab> (finished: subtest: eval and build post commit statuses, in 6.41 seconds)2027vm-test-run-nixbot-gitlab> (finished: run the VM test script, in 383.46 seconds)2028vm-test-run-nixbot-gitlab> gitlab # [  319.434525] gitaly[1358]: time="2026-06-17T14:57:34.355Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=5 command.system_time_ms=0 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KVB1CV0P9B9D0SY9C153SCCG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=206 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-17T14:57:34.344" grpc.time_ms=11.373 pid=1358 remote_ip="2001:db8:1::1" span.kind=server system=grpc2029vm-test-run-nixbot-gitlab> gitlab # [  319.447999] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:34 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 1252030vm-test-run-nixbot-gitlab> gitlab # [  319.452691] gitlab-workhorse[1290]: gitlab 2001:db8:1::1 - - [2026/06/17:14:57:34 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/e1a496791a7f15c5bb7e99d876a15f5491f0ced5/statuses HTTP/1.1" 200 1328 "" "curl/8.20.0" 1342031vm-test-run-nixbot-gitlab> gitlab # [  319.455214] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:34.382Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"94f50d8c638b9186802ceb98","created_at":"2026-06-17T14:57:33.466Z","trace_propagation_headers":{"sentry-trace":"cfe3c0cc37744c5fb18b7242c022107c-fae1285313174255","baggage":"sentry-trace_id=cfe3c0cc37744c5fb18b7242c022107c,sentry-release=Unknown"},"correlation_id":"01KVB1CSP259Z5WPQBXYDB8VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:33.477Z","job_size_bytes":23,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-94f50d8c638b9186802ceb98: done: 0.117838 sec","job_status":"done","queue_duration_s":0.786977,"scheduling_latency_s":0.787014,"redis_calls":10,"redis_duration_s":0.008128,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002863,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004601,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000664,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.081499,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026436,"duration_s":0.117838,"completed_at":"2026-06-17T14:57:34.382Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012769,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2032vm-test-run-nixbot-gitlab> gitlab # [  319.500677] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:34.387Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"9ffd212df6103bacd9533082","created_at":"2026-06-17T14:57:33.675Z","trace_propagation_headers":{"sentry-trace":"cfe3c0cc37744c5fb18b7242c022107c-fae1285313174255","baggage":"sentry-trace_id=cfe3c0cc37744c5fb18b7242c022107c,sentry-release=Unknown"},"correlation_id":"01KVB1CSP259Z5WPQBXYDB8VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:33.684Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-9ffd212df6103bacd9533082: start","job_status":"start","queue_duration_s":0.702949,"scheduling_latency_s":0.702978}2033vm-test-run-nixbot-gitlab> test script finished in 383.59s2034vm-test-run-nixbot-gitlab> cleanup2035vm-test-run-nixbot-gitlab> gitlab # [  319.518762] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:34.425Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"9ffd212df6103bacd9533082","created_at":"2026-06-17T14:57:33.675Z","trace_propagation_headers":{"sentry-trace":"cfe3c0cc37744c5fb18b7242c022107c-fae1285313174255","baggage":"sentry-trace_id=cfe3c0cc37744c5fb18b7242c022107c,sentry-release=Unknown"},"correlation_id":"01KVB1CSP259Z5WPQBXYDB8VVP","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-06-17T14:57:33.684Z","job_size_bytes":3,"pid":2420,"sidekiq_tid":"m4f4","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-9ffd212df6103bacd9533082: done: 0.038141 sec","job_status":"done","queue_duration_s":0.702949,"scheduling_latency_s":0.702978,"redis_calls":10,"redis_duration_s":0.002383,"redis_read_bytes":9,"redis_write_bytes":1165,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000291,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":329,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000411,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":234,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021916,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004392,"duration_s":0.038141,"completed_at":"2026-06-17T14:57:34.425Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00644,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}2036vm-test-run-nixbot-gitlab> kill QemuMachine (pid 13)2037vm-test-run-nixbot-gitlab> gitlab # [  319.565926] sidekiq-cluster[2420]: {"severity":"INFO","time":"2026-06-17T14:57:34.426Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::PipelineArtifacts::CreateQualityReportWorker","jid":"92d132a54f8f1421385a1b08","created_at":"2026-06-17T14:57:33.993Z","trace_propagation_headers":{"sentry-trace":"cfe3c0cc37744c5fb18b7242c022107c-fae128531qemu-system-aarch64: terminating on signal 15 from pid 6 (/nix/store/lqn6mbgzzdrqq2qkwddcmxj9z6amdd86-python3-3.13.13/bin/python3.13)2038vm-test-run-nixbot-gitlab> (finished: cleanup, in 1.32 seconds)20392040post-build step Upload coverage to codecov: ok2041Skipping codecov: project=Mic92/nixbot attr=aarch64-linux.nixbot-gitlab