nixbot

1these 13 derivations will be built:2  /nix/store/d1027smxwf779s9f0ri7nsr0nn3swdm3-nixbot-effects.drv3  /nix/store/qasm9gj0bwab7n3d4ns06wgv06k7cv0x-unit-nixbot.service.drv4  /nix/store/0r6k6h02ar7c2pa6m1270gkwdwhac8p7-system-units.drv5  /nix/store/ai4glgkwy3arfj5ymjr0d8mhwsq5z2w9-etc.drv6  /nix/store/1kfkclpsnyx65hjaf5c3rj107wnszz28-activate.drv7  /nix/store/kh5m242w4jg650424wjssxaz21s6hb6f-nixos-system-gitlab-test.drv8  /nix/store/q4k52cdka36f5xvvqpxrxd0sxy59aslx-closure-info.drv9  /nix/store/fz5cmjj5mbm7piyjqhy70nm0s0vssyyb-closure-info.drv10  /nix/store/a6crx36nrlqhp3qcsan0nqdc1r764rns-run-nixos-vm.drv11  /nix/store/98jdyphn8ji4sabxplqxfikpsxjgphab-nixos-vm.drv12  /nix/store/73h3r6l2sjzcsqghkmxawns508fbqrjb-driverConfiguration.json.drv13  /nix/store/047ak6rd3bwgw7zdx2kyf9fk0lq7ikgn-nixos-test-driver-nixbot-gitlab.drv14  /nix/store/1zkji4j8kmrsi2x5dxrm3xn2zcbf13ql-vm-test-run-nixbot-gitlab.drv15building '/nix/store/d1027smxwf779s9f0ri7nsr0nn3swdm3-nixbot-effects.drv' on 'ssh-ng://nix@eliza'16building '/nix/store/d1027smxwf779s9f0ri7nsr0nn3swdm3-nixbot-effects.drv'17nixbot-effects> Sourcing python-remove-tests-dir-hook18nixbot-effects> Sourcing python-catch-conflicts-hook.sh19nixbot-effects> Sourcing python-remove-bin-bytecode-hook.sh20nixbot-effects> Sourcing pypa-build-hook21nixbot-effects> Using pypaBuildPhase22nixbot-effects> Sourcing python-runtime-deps-check-hook23nixbot-effects> Using pythonRuntimeDepsCheckHook24nixbot-effects> Sourcing pypa-install-hook25nixbot-effects> Using pypaInstallPhase26nixbot-effects> Sourcing python-imports-check-hook.sh27nixbot-effects> Using pythonImportsCheckPhase28nixbot-effects> Sourcing python-namespaces-hook29nixbot-effects> Sourcing python-catch-conflicts-hook.sh30nixbot-effects> Running phase: unpackPhase31nixbot-effects> unpacking source archive /nix/store/d39xb4grzwjgfvih4zz1khwi4cxqrn9d-nixbot_effects32nixbot-effects> source root is nixbot_effects33nixbot-effects> setting SOURCE_DATE_EPOCH to timestamp 315619200 of file "nixbot_effects/pyproject.toml"34nixbot-effects> Running phase: patchPhase35nixbot-effects> Running phase: updateAutotoolsGnuConfigScriptsPhase36nixbot-effects> Running phase: configurePhase37nixbot-effects> no configure script, doing nothing38nixbot-effects> Running phase: buildPhase39nixbot-effects> Executing pypaBuildPhase40nixbot-effects> Creating a wheel...41nixbot-effects> pypa build flags: --no-isolation --outdir dist/ --wheel42nixbot-effects> * Getting build dependencies for wheel...43nixbot-effects> * Building wheel...44nixbot-effects> Successfully built nixbot_effects-0.0.1-py3-none-any.whl45nixbot-effects> Finished creating a wheel...46nixbot-effects> Finished executing pypaBuildPhase47nixbot-effects> Running phase: pythonRuntimeDepsCheckHook48nixbot-effects> Executing pythonRuntimeDepsCheck49nixbot-effects> Checking runtime dependencies for nixbot_effects-0.0.1-py3-none-any.whl50nixbot-effects> Finished executing pythonRuntimeDepsCheck51nixbot-effects> Running phase: installPhase52nixbot-effects> Executing pypaInstallPhase53nixbot-effects> Successfully installed nixbot_effects-0.0.1-py3-none-any.whl54nixbot-effects> Finished executing pypaInstallPhase55nixbot-effects> Running phase: pythonOutputDistPhase56nixbot-effects> Executing pythonOutputDistPhase57nixbot-effects> Finished executing pythonOutputDistPhase58nixbot-effects> Running phase: fixupPhase59nixbot-effects> shrinking RPATHs of ELF executables and libraries in /nix/store/cdzj5kalnlnw373vr8q8788g0xrwcs98-nixbot-effects60nixbot-effects> checking for references to /build/ in /nix/store/cdzj5kalnlnw373vr8q8788g0xrwcs98-nixbot-effects...61nixbot-effects> patching script interpreter paths in /nix/store/cdzj5kalnlnw373vr8q8788g0xrwcs98-nixbot-effects62nixbot-effects> stripping (with command strip and flags -S -p) in  /nix/store/cdzj5kalnlnw373vr8q8788g0xrwcs98-nixbot-effects/lib /nix/store/cdzj5kalnlnw373vr8q8788g0xrwcs98-nixbot-effects/bin63nixbot-effects> shrinking RPATHs of ELF executables and libraries in /nix/store/a8vih3sk2dr39ggfwqnm80hv5nv7a5aq-nixbot-effects-dist64nixbot-effects> checking for references to /build/ in /nix/store/a8vih3sk2dr39ggfwqnm80hv5nv7a5aq-nixbot-effects-dist...65nixbot-effects> patching script interpreter paths in /nix/store/a8vih3sk2dr39ggfwqnm80hv5nv7a5aq-nixbot-effects-dist66nixbot-effects> Rewriting #!/nix/store/lqn6mbgzzdrqq2qkwddcmxj9z6amdd86-python3-3.13.13/bin/python3.13 to #!/nix/store/lqn6mbgzzdrqq2qkwddcmxj9z6amdd86-python3-3.13.1367nixbot-effects> wrapping `/nix/store/cdzj5kalnlnw373vr8q8788g0xrwcs98-nixbot-effects/bin/nixbot-effects'...68nixbot-effects> Executing pythonRemoveTestsDir69nixbot-effects> Finished executing pythonRemoveTestsDir70nixbot-effects> Running phase: installCheckPhase71nixbot-effects> no Makefile or custom installCheckPhase, doing nothing72nixbot-effects> Running phase: pythonCatchConflictsPhase73nixbot-effects> Running phase: pythonRemoveBinBytecodePhase74nixbot-effects> Running phase: pythonImportsCheckPhase75nixbot-effects> Executing pythonImportsCheckPhase76building '/nix/store/qasm9gj0bwab7n3d4ns06wgv06k7cv0x-unit-nixbot.service.drv' on 'ssh-ng://nix@eliza'77building '/nix/store/qasm9gj0bwab7n3d4ns06wgv06k7cv0x-unit-nixbot.service.drv'78building '/nix/store/0r6k6h02ar7c2pa6m1270gkwdwhac8p7-system-units.drv' on 'ssh-ng://nix@eliza'79building '/nix/store/0r6k6h02ar7c2pa6m1270gkwdwhac8p7-system-units.drv'80building '/nix/store/ai4glgkwy3arfj5ymjr0d8mhwsq5z2w9-etc.drv' on 'ssh-ng://nix@eliza'81building '/nix/store/ai4glgkwy3arfj5ymjr0d8mhwsq5z2w9-etc.drv'82building '/nix/store/1kfkclpsnyx65hjaf5c3rj107wnszz28-activate.drv' on 'ssh-ng://nix@eliza'83building '/nix/store/1kfkclpsnyx65hjaf5c3rj107wnszz28-activate.drv'84building '/nix/store/kh5m242w4jg650424wjssxaz21s6hb6f-nixos-system-gitlab-test.drv' on 'ssh-ng://nix@eliza'85building '/nix/store/kh5m242w4jg650424wjssxaz21s6hb6f-nixos-system-gitlab-test.drv'86nixos-system-gitlab-test> structuredAttrs is enabled87building '/nix/store/q4k52cdka36f5xvvqpxrxd0sxy59aslx-closure-info.drv' on 'ssh-ng://nix@eliza'88building '/nix/store/q4k52cdka36f5xvvqpxrxd0sxy59aslx-closure-info.drv'89closure-info> structuredAttrs is enabled90building '/nix/store/fz5cmjj5mbm7piyjqhy70nm0s0vssyyb-closure-info.drv' on 'ssh-ng://nix@eliza'91building '/nix/store/fz5cmjj5mbm7piyjqhy70nm0s0vssyyb-closure-info.drv'92closure-info> structuredAttrs is enabled93building '/nix/store/a6crx36nrlqhp3qcsan0nqdc1r764rns-run-nixos-vm.drv' on 'ssh-ng://nix@eliza'94building '/nix/store/a6crx36nrlqhp3qcsan0nqdc1r764rns-run-nixos-vm.drv'95building '/nix/store/98jdyphn8ji4sabxplqxfikpsxjgphab-nixos-vm.drv' on 'ssh-ng://nix@eliza'96building '/nix/store/98jdyphn8ji4sabxplqxfikpsxjgphab-nixos-vm.drv'97building '/nix/store/73h3r6l2sjzcsqghkmxawns508fbqrjb-driverConfiguration.json.drv' on 'ssh-ng://nix@eliza'98building '/nix/store/73h3r6l2sjzcsqghkmxawns508fbqrjb-driverConfiguration.json.drv'99driverConfiguration.json> structuredAttrs is enabled100building '/nix/store/047ak6rd3bwgw7zdx2kyf9fk0lq7ikgn-nixos-test-driver-nixbot-gitlab.drv' on 'ssh-ng://nix@eliza'101building '/nix/store/047ak6rd3bwgw7zdx2kyf9fk0lq7ikgn-nixos-test-driver-nixbot-gitlab.drv'102nixos-test-driver-nixbot-gitlab> Running type check (enable/disable: config.skipTypeCheck)103nixos-test-driver-nixbot-gitlab> See https://nixos.org/manual/nixos/stable/#test-opt-skipTypeCheck104nixos-test-driver-nixbot-gitlab> All checks passed!105nixos-test-driver-nixbot-gitlab> Linting test script (enable/disable: config.skipLint)106nixos-test-driver-nixbot-gitlab> See https://nixos.org/manual/nixos/stable/#test-opt-skipLint107nixos-test-driver-nixbot-gitlab> All checks passed!108building '/nix/store/1zkji4j8kmrsi2x5dxrm3xn2zcbf13ql-vm-test-run-nixbot-gitlab.drv' on 'ssh-ng://nix@eliza'109building '/nix/store/1zkji4j8kmrsi2x5dxrm3xn2zcbf13ql-vm-test-run-nixbot-gitlab.drv'110vm-test-run-nixbot-gitlab> Machine state will be reset. To keep it, pass --keep-machine-state111vm-test-run-nixbot-gitlab> start all VLans112vm-test-run-nixbot-gitlab> (finished: start all VLans, in 0.00 seconds)113vm-test-run-nixbot-gitlab> Test will time out and terminate in 3600 seconds114vm-test-run-nixbot-gitlab> run the VM test script115vm-test-run-nixbot-gitlab> additionally exposed symbols:116vm-test-run-nixbot-gitlab>     gitlab,117vm-test-run-nixbot-gitlab>     vlan1,118vm-test-run-nixbot-gitlab>     start_all, test_script, machines, machines_qemu, machines_nspawn, vlans, driver, log, os, create_machine, subtest, run_tests, join_all, retry, serial_stdout_off, serial_stdout_on, polling_condition, BaseMachine, QemuMachine, NspawnMachine, t, debug, dump_machine_ssh119vm-test-run-nixbot-gitlab> start all VMs120vm-test-run-nixbot-gitlab> gitlab: starting vm121vm-test-run-nixbot-gitlab> gitlab # Disk image does not exist, creating the virtualisation disk image...122vm-test-run-nixbot-gitlab> gitlab: QEMU running (pid 13)123vm-test-run-nixbot-gitlab> gitlab # Formatting '/build/vm-state-gitlab/tmp.qn1siGkJYB', fmt=raw size=1073741824124vm-test-run-nixbot-gitlab> gitlab # mke2fs 1.47.3 (8-Jul-2025)125vm-test-run-nixbot-gitlab> gitlab # Discarding device blocks:      0/262144             done126vm-test-run-nixbot-gitlab> gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes127vm-test-run-nixbot-gitlab> gitlab # Filesystem UUID: 817e4e80-66f1-47f4-ae8c-8a18caa25209128vm-test-run-nixbot-gitlab> gitlab # Superblock backups stored on blocks:129vm-test-run-nixbot-gitlab> (finished: start all VMs, in 66.41 seconds)130vm-test-run-nixbot-gitlab> gitlab # 	32768, 98304, 163840, 229376131vm-test-run-nixbot-gitlab> gitlab: waiting for unit setup-gitlab.service132vm-test-run-nixbot-gitlab> gitlab # 133vm-test-run-nixbot-gitlab> gitlab: waiting for the VM to finish booting134vm-test-run-nixbot-gitlab> gitlab # Allocating group tables: 0/8   done135vm-test-run-nixbot-gitlab> gitlab # Writing inode tables: 0/8   done136vm-test-run-nixbot-gitlab> gitlab # Creating journal (8192 blocks): done137vm-test-run-nixbot-gitlab> gitlab # Writing superblocks and filesystem accounting information: 0/8   done138vm-test-run-nixbot-gitlab> gitlab # 139vm-test-run-nixbot-gitlab> gitlab # Virtualisation disk image created.140vm-test-run-nixbot-gitlab> gitlab # Creating Nix store image...141vm-test-run-nixbot-gitlab> gitlab # Created Nix store image.142vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]143vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Linux version 6.18.34 (nixbld@localhost) (gcc (GCC) 15.2.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Mon Jun  1 15:51:08 UTC 2026144vm-test-run-nixbot-gitlab> gitlab # [    0.000000] KASLR enabled145vm-test-run-nixbot-gitlab> gitlab # [    0.000000] random: crng init done146vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Machine model: linux,dummy-virt147vm-test-run-nixbot-gitlab> gitlab # [    0.000000] efi: UEFI not found.148vm-test-run-nixbot-gitlab> gitlab # [    0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT149vm-test-run-nixbot-gitlab> gitlab # [    0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]150vm-test-run-nixbot-gitlab> gitlab # [    0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]151vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Zone ranges:152vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   DMA      [mem 0x0000000040000000-0x00000000ffffffff]153vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   DMA32    empty154vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   Normal   [mem 0x0000000100000000-0x00000001bfffffff]155vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   Device   empty156vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Movable zone start for each node157vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Early memory node ranges158vm-test-run-nixbot-gitlab> gitlab # [    0.000000]   node   0: [mem 0x0000000040000000-0x00000001bfffffff]159vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]160vm-test-run-nixbot-gitlab> gitlab # [    0.000000] cma: Reserved 32 MiB at 0x00000000fe000000161vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: probing for conduit method from DT.162vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: PSCIv1.3 detected in firmware.163vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: Using standard PSCI v0.2 function IDs164vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: Trusted OS migration not required165vm-test-run-nixbot-gitlab> gitlab # [    0.000000] psci: SMC Calling Convention v1.1166vm-test-run-nixbot-gitlab> gitlab # [    0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)167vm-test-run-nixbot-gitlab> gitlab # [    0.000000] percpu: Embedded 76 pages/cpu s185944 r8192 d117160 u311296168vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Detected PIPT I-cache on CPU0169vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)170vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: GICv3 CPU interface171vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: Spectre-v4172vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: Spectre-BHB173vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_38174vm-test-run-nixbot-gitlab> gitlab # [    0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_23175vm-test-run-nixbot-gitlab> gitlab # [    0.000000] alternatives: applying boot alternatives176vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/f154ch9l48fgwkvy5y6iklk2i2fl9dp0-nixos-system-gitlab-test/init regInfo=/nix/store/57hsv06fl6v23783w2h19f7ll34d6qsj-closure-info/registration console=ttyAMA0,115200n8 console=tty0177vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Unknown kernel command line parameters "regInfo=/nix/store/57hsv06fl6v23783w2h19f7ll34d6qsj-closure-info/registration", will be passed to user space.178vm-test-run-nixbot-gitlab> gitlab # [    0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes179vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)180vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)181vm-test-run-nixbot-gitlab> gitlab # [    0.000000] software IO TLB: area num 4.182vm-test-run-nixbot-gitlab> gitlab # [    0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)183vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Fallback order for Node 0: 0184vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Built 1 zonelists, mobility grouping on.  Total pages: 1572864185vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Policy zone: Normal186vm-test-run-nixbot-gitlab> gitlab # [    0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off187vm-test-run-nixbot-gitlab> gitlab # [    0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=1188vm-test-run-nixbot-gitlab> gitlab # [    0.000000] allocated 12582912 bytes of page_ext189vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ftrace: allocating 74648 entries in 292 pages190vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ftrace: allocated 292 pages with 3 groups191vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: Hierarchical RCU implementation.192vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: 	RCU event tracing is enabled.193vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: 	RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.194vm-test-run-nixbot-gitlab> gitlab # [    0.000000] 	Trampoline variant of Tasks RCU enabled.195vm-test-run-nixbot-gitlab> gitlab # [    0.000000] 	Rude variant of Tasks RCU enabled.196vm-test-run-nixbot-gitlab> gitlab # [    0.000000] 	Tracing variant of Tasks RCU enabled.197vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.198vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=4199vm-test-run-nixbot-gitlab> gitlab # [    0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.200vm-test-run-nixbot-gitlab> gitlab # [    0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.201vm-test-run-nixbot-gitlab> gitlab # [    0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.202vm-test-run-nixbot-gitlab> gitlab # [    0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0203vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: 256 SPIs implemented204vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: 0 Extended SPIs implemented205vm-test-run-nixbot-gitlab> gitlab # [    0.000000] Root IRQ handler: gic_handle_irq206vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI207vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0208vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000209vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ITS [mem 0x08080000-0x0809ffff]210vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)211vm-test-run-nixbot-gitlab> gitlab # [    0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)212vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: using LPI property table @0x0000000100f30000213vm-test-run-nixbot-gitlab> gitlab # [    0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000214vm-test-run-nixbot-gitlab> gitlab # [    0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.215vm-test-run-nixbot-gitlab> gitlab # [    0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).216vm-test-run-nixbot-gitlab> gitlab # [    0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns217vm-test-run-nixbot-gitlab> gitlab # [    0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns218vm-test-run-nixbot-gitlab> gitlab # [    0.000027] arm-pv: using stolen time PV219vm-test-run-nixbot-gitlab> gitlab # [    0.000359] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)220vm-test-run-nixbot-gitlab> gitlab # [    0.000553] Console: colour dummy device 80x25221vm-test-run-nixbot-gitlab> gitlab # [    0.000561] printk: legacy console [tty0] enabled222vm-test-run-nixbot-gitlab> gitlab # [    0.000734] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)223vm-test-run-nixbot-gitlab> gitlab # [    0.000741] pid_max: default: 32768 minimum: 301224vm-test-run-nixbot-gitlab> gitlab # [    0.000818] LSM: initializing lsm=capability,landlock,yama,bpf,ima225vm-test-run-nixbot-gitlab> gitlab # [    0.000940] landlock: Up and running.226vm-test-run-nixbot-gitlab> gitlab # [    0.000943] Yama: becoming mindful.227vm-test-run-nixbot-gitlab> gitlab # [    0.001346] LSM support for eBPF active228vm-test-run-nixbot-gitlab> gitlab # [    0.001544] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)229vm-test-run-nixbot-gitlab> gitlab # [    0.001653] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)230vm-test-run-nixbot-gitlab> gitlab # [    0.002777] cacheinfo: Unable to detect cache hierarchy for CPU 0231vm-test-run-nixbot-gitlab> gitlab # [    0.003714] rcu: Hierarchical SRCU implementation.232vm-test-run-nixbot-gitlab> gitlab # [    0.003718] rcu: 	Max phase no-delay instances is 1000.233vm-test-run-nixbot-gitlab> gitlab # [    0.003873] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level234vm-test-run-nixbot-gitlab> gitlab # [    0.004926] fsl-mc MSI: its@8080000 domain created235vm-test-run-nixbot-gitlab> gitlab # [    0.005018] EFI services will not be available.236vm-test-run-nixbot-gitlab> gitlab # [    0.005220] smp: Bringing up secondary CPUs ...237vm-test-run-nixbot-gitlab> gitlab # [    0.005878] Detected PIPT I-cache on CPU1238vm-test-run-nixbot-gitlab> gitlab # [    0.005976] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000239vm-test-run-nixbot-gitlab> gitlab # [    0.006110] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000240vm-test-run-nixbot-gitlab> gitlab # [    0.006239] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]241vm-test-run-nixbot-gitlab> gitlab # [    0.007389] Detected PIPT I-cache on CPU2242vm-test-run-nixbot-gitlab> gitlab # [    0.007572] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000243vm-test-run-nixbot-gitlab> gitlab # [    0.007704] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000244vm-test-run-nixbot-gitlab> gitlab # [    0.007835] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]245vm-test-run-nixbot-gitlab> gitlab # [    0.008827] Detected PIPT I-cache on CPU3246vm-test-run-nixbot-gitlab> gitlab # [    0.008942] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000247vm-test-run-nixbot-gitlab> gitlab # [    0.009073] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000248vm-test-run-nixbot-gitlab> gitlab # [    0.009202] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]249vm-test-run-nixbot-gitlab> gitlab # [    0.009703] smp: Brought up 1 node, 4 CPUs250vm-test-run-nixbot-gitlab> gitlab # [    0.009731] SMP: Total of 4 processors activated.251vm-test-run-nixbot-gitlab> gitlab # [    0.009733] CPU: All CPU(s) started at EL1252vm-test-run-nixbot-gitlab> gitlab # [    0.009741] CPU features: detected: Branch Target Identification253vm-test-run-nixbot-gitlab> gitlab # [    0.009745] CPU features: detected: ARMv8.4 Translation Table Level254vm-test-run-nixbot-gitlab> gitlab # [    0.009748] CPU features: detected: Instruction cache invalidation not required for I/D coherence255vm-test-run-nixbot-gitlab> gitlab # [    0.009751] CPU features: detected: Data cache clean to the PoU not required for I/D coherence256vm-test-run-nixbot-gitlab> gitlab # [    0.009755] CPU features: detected: Common not Private translations257vm-test-run-nixbot-gitlab> gitlab # [    0.009757] CPU features: detected: CRC32 instructions258vm-test-run-nixbot-gitlab> gitlab # [    0.009760] CPU features: detected: Data cache clean to Point of Deep Persistence259vm-test-run-nixbot-gitlab> gitlab # [    0.009763] CPU features: detected: Data cache clean to Point of Persistence260vm-test-run-nixbot-gitlab> gitlab # [    0.009766] CPU features: detected: Data independent timing control (DIT)261vm-test-run-nixbot-gitlab> gitlab # [    0.009769] CPU features: detected: E0PD262vm-test-run-nixbot-gitlab> gitlab # [    0.009771] CPU features: detected: Enhanced Counter Virtualization263vm-test-run-nixbot-gitlab> gitlab # [    0.009774] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)264vm-test-run-nixbot-gitlab> gitlab # [    0.009777] CPU features: detected: Enhanced Virtualization Traps265vm-test-run-nixbot-gitlab> gitlab # [    0.009779] CPU features: detected: Fine Grained Traps266vm-test-run-nixbot-gitlab> gitlab # [    0.009782] CPU features: detected: Generic authentication (architected QARMA5 algorithm)267vm-test-run-nixbot-gitlab> gitlab # [    0.009786] CPU features: detected: RCpc load-acquire (LDAPR)268vm-test-run-nixbot-gitlab> gitlab # [    0.009788] CPU features: detected: LSE atomic instructions269vm-test-run-nixbot-gitlab> gitlab # [    0.009791] CPU features: detected: Privileged Access Never270vm-test-run-nixbot-gitlab> gitlab # [    0.009793] CPU features: detected: PMUv3271vm-test-run-nixbot-gitlab> gitlab # [    0.009796] CPU features: detected: RAS Extension Support272vm-test-run-nixbot-gitlab> gitlab # [    0.009798] CPU features: detected: RASv1p1 Extension Support273vm-test-run-nixbot-gitlab> gitlab # [    0.009801] CPU features: detected: Random Number Generator274vm-test-run-nixbot-gitlab> gitlab # [    0.009803] CPU features: detected: Speculation barrier (SB)275vm-test-run-nixbot-gitlab> gitlab # [    0.009805] CPU features: detected: Stage-2 Force Write-Back276vm-test-run-nixbot-gitlab> gitlab # [    0.009808] CPU features: detected: TLB range maintenance instructions277vm-test-run-nixbot-gitlab> gitlab # [    0.009812] CPU features: detected: Speculative Store Bypassing Safe (SSBS)278vm-test-run-nixbot-gitlab> gitlab # [    0.009946] alternatives: applying system-wide alternatives279vm-test-run-nixbot-gitlab> gitlab # [    0.012834] CPU features: detected: BBM Level 2 without TLB conflict abort280vm-test-run-nixbot-gitlab> gitlab # [    0.012995] Memory: 5965752K/6291456K available (24320K kernel code, 7086K rwdata, 26308K rodata, 4736K init, 1102K bss, 270904K reserved, 32768K cma-reserved)281vm-test-run-nixbot-gitlab> gitlab # [    0.014447] devtmpfs: initialized282vm-test-run-nixbot-gitlab> gitlab # [    0.018368] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns283vm-test-run-nixbot-gitlab> gitlab # [    0.018433] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)284vm-test-run-nixbot-gitlab> gitlab # [    0.018498] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).285vm-test-run-nixbot-gitlab> gitlab # [    0.018709] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL286vm-test-run-nixbot-gitlab> gitlab # [    0.018714] 0 pages in range for non-PLT usage287vm-test-run-nixbot-gitlab> gitlab # [    0.018716] 508336 pages in range for PLT usage288vm-test-run-nixbot-gitlab> gitlab # [    0.018860] pinctrl core: initialized pinctrl subsystem289vm-test-run-nixbot-gitlab> gitlab # [    0.019721] DMI not present or invalid.290vm-test-run-nixbot-gitlab> gitlab # [    0.022880] NET: Registered PF_NETLINK/PF_ROUTE protocol family291vm-test-run-nixbot-gitlab> gitlab # [    0.025445] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations292vm-test-run-nixbot-gitlab> gitlab # [    0.025725] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations293vm-test-run-nixbot-gitlab> gitlab # [    0.027947] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations294vm-test-run-nixbot-gitlab> gitlab # [    0.027973] audit: initializing netlink subsys (disabled)295vm-test-run-nixbot-gitlab> gitlab # [    0.028288] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1296vm-test-run-nixbot-gitlab> gitlab # [    0.028745] thermal_sys: Registered thermal governor 'fair_share'297vm-test-run-nixbot-gitlab> gitlab # [    0.028747] thermal_sys: Registered thermal governor 'bang_bang'298vm-test-run-nixbot-gitlab> gitlab # [    0.028752] thermal_sys: Registered thermal governor 'step_wise'299vm-test-run-nixbot-gitlab> gitlab # [    0.028755] thermal_sys: Registered thermal governor 'user_space'300vm-test-run-nixbot-gitlab> gitlab # [    0.028757] thermal_sys: Registered thermal governor 'power_allocator'301vm-test-run-nixbot-gitlab> gitlab # [    0.028838] cpuidle: using governor ladder302vm-test-run-nixbot-gitlab> gitlab # [    0.028863] cpuidle: using governor menu303vm-test-run-nixbot-gitlab> gitlab # [    0.029072] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.304vm-test-run-nixbot-gitlab> gitlab # [    0.029275] ASID allocator initialised with 65536 entries305vm-test-run-nixbot-gitlab> gitlab # [    0.030406] Serial: AMBA PL011 UART driver306vm-test-run-nixbot-gitlab> gitlab # [    0.035509] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1307vm-test-run-nixbot-gitlab> gitlab # [    0.035781] printk: console [ttyAMA0] enabled308vm-test-run-nixbot-gitlab> gitlab # [    0.047415] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages309vm-test-run-nixbot-gitlab> gitlab # [    0.047433] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page310vm-test-run-nixbot-gitlab> gitlab # [    0.047442] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages311vm-test-run-nixbot-gitlab> gitlab # [    0.047450] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page312vm-test-run-nixbot-gitlab> gitlab # [    0.047459] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages313vm-test-run-nixbot-gitlab> gitlab # [    0.047466] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page314vm-test-run-nixbot-gitlab> gitlab # [    0.047475] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages315vm-test-run-nixbot-gitlab> gitlab # [    0.047482] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page316vm-test-run-nixbot-gitlab> gitlab # [    0.060258] fbcon: Taking over console317vm-test-run-nixbot-gitlab> gitlab # [    0.060268] ACPI: Interpreter disabled.318vm-test-run-nixbot-gitlab> gitlab # [    0.061289] iommu: Default domain type: Translated319vm-test-run-nixbot-gitlab> gitlab # [    0.061293] iommu: DMA domain TLB invalidation policy: strict mode320vm-test-run-nixbot-gitlab> gitlab # [    0.076399] SCSI subsystem initialized321vm-test-run-nixbot-gitlab> gitlab # [    0.077596] usbcore: registered new interface driver usbfs322vm-test-run-nixbot-gitlab> gitlab # [    0.077779] usbcore: registered new interface driver hub323vm-test-run-nixbot-gitlab> gitlab # [    0.077822] usbcore: registered new device driver usb324vm-test-run-nixbot-gitlab> gitlab # [    0.078686] pps_core: LinuxPPS API ver. 1 registered325vm-test-run-nixbot-gitlab> gitlab # [    0.078697] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>326vm-test-run-nixbot-gitlab> gitlab # [    0.078719] PTP clock support registered327vm-test-run-nixbot-gitlab> gitlab # [    0.078817] EDAC MC: Ver: 3.0.0328vm-test-run-nixbot-gitlab> gitlab # [    0.079571] scmi_core: SCMI protocol bus registered329vm-test-run-nixbot-gitlab> gitlab # [    0.080736] FPGA manager framework330vm-test-run-nixbot-gitlab> gitlab # [    0.083136] vgaarb: loaded331vm-test-run-nixbot-gitlab> gitlab # [    0.084476] clocksource: Switched to clocksource arch_sys_counter332vm-test-run-nixbot-gitlab> gitlab # [    0.085776] VFS: Disk quotas dquot_6.6.0333vm-test-run-nixbot-gitlab> gitlab # [    0.085853] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)334vm-test-run-nixbot-gitlab> gitlab # [    0.089721] netfs: FS-Cache loaded335vm-test-run-nixbot-gitlab> gitlab # [    0.090223] pnp: PnP ACPI: disabled336vm-test-run-nixbot-gitlab> gitlab # [    0.101474] NET: Registered PF_INET protocol family337vm-test-run-nixbot-gitlab> gitlab # [    0.104254] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)338vm-test-run-nixbot-gitlab> gitlab # [    0.166285] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)339vm-test-run-nixbot-gitlab> gitlab # [    0.166356] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)340vm-test-run-nixbot-gitlab> gitlab # [    0.166416] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)341vm-test-run-nixbot-gitlab> gitlab # [    0.166889] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)342vm-test-run-nixbot-gitlab> gitlab # [    0.167820] TCP: Hash tables configured (established 65536 bind 65536)343vm-test-run-nixbot-gitlab> gitlab # [    0.167933] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)344vm-test-run-nixbot-gitlab> gitlab # [    0.168014] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)345vm-test-run-nixbot-gitlab> gitlab # [    0.168193] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)346vm-test-run-nixbot-gitlab> gitlab # [    0.168541] NET: Registered PF_UNIX/PF_LOCAL protocol family347vm-test-run-nixbot-gitlab> gitlab # [    0.168576] NET: Registered PF_XDP protocol family348vm-test-run-nixbot-gitlab> gitlab # [    0.168596] PCI: CLS 0 bytes, default 64349vm-test-run-nixbot-gitlab> gitlab # [    0.169000] Trying to unpack rootfs image as initramfs...350vm-test-run-nixbot-gitlab> gitlab # [    0.180595] kvm [1]: HYP mode not available351vm-test-run-nixbot-gitlab> gitlab # [    0.272705] Initialise system trusted keyrings352vm-test-run-nixbot-gitlab> gitlab # [    0.273090] workingset: timestamp_bits=42 max_order=21 bucket_order=0353vm-test-run-nixbot-gitlab> gitlab # [    0.274309] squashfs: version 4.0 (2009/01/31) Phillip Lougher354vm-test-run-nixbot-gitlab> gitlab # [    0.274488] 9p: Installing v9fs 9p2000 file system support355vm-test-run-nixbot-gitlab> gitlab # [    0.311111] Key type asymmetric registered356vm-test-run-nixbot-gitlab> gitlab # [    0.311140] Asymmetric key parser 'x509' registered357vm-test-run-nixbot-gitlab> gitlab # [    0.311293] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)358vm-test-run-nixbot-gitlab> gitlab # [    0.311608] io scheduler mq-deadline registered359vm-test-run-nixbot-gitlab> gitlab # [    0.311623] io scheduler kyber registered360vm-test-run-nixbot-gitlab> gitlab # [    0.328702] pl061_gpio 9030000.pl061: PL061 GPIO chip registered361vm-test-run-nixbot-gitlab> gitlab # [    0.332551] ledtrig-cpu: registered to indicate activity on CPUs362vm-test-run-nixbot-gitlab> gitlab # [    0.333938] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:363vm-test-run-nixbot-gitlab> gitlab # [    0.333974] pci-host-generic 4010000000.pcie:       IO 0x003eff0000..0x003effffff -> 0x0000000000364vm-test-run-nixbot-gitlab> gitlab # [    0.334001] pci-host-generic 4010000000.pcie:      MEM 0x0010000000..0x003efeffff -> 0x0010000000365vm-test-run-nixbot-gitlab> gitlab # [    0.334017] pci-host-generic 4010000000.pcie:      MEM 0x8000000000..0xffffffffff -> 0x8000000000366vm-test-run-nixbot-gitlab> gitlab # [    0.334064] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits367vm-test-run-nixbot-gitlab> gitlab # [    0.334115] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]368vm-test-run-nixbot-gitlab> gitlab # [    0.334408] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00369vm-test-run-nixbot-gitlab> gitlab # [    0.334448] pci_bus 0000:00: root bus resource [bus 00-ff]370vm-test-run-nixbot-gitlab> gitlab # [    0.334480] pci_bus 0000:00: root bus resource [io  0x0000-0xffff]371vm-test-run-nixbot-gitlab> gitlab # [    0.334491] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]372vm-test-run-nixbot-gitlab> gitlab # [    0.334500] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]373vm-test-run-nixbot-gitlab> gitlab # [    0.334755] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint374vm-test-run-nixbot-gitlab> gitlab # [    0.336270] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint375vm-test-run-nixbot-gitlab> gitlab # [    0.336981] pci 0000:00:01.0: BAR 0 [io  0x0000-0x001f]376vm-test-run-nixbot-gitlab> gitlab # [    0.337019] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]377vm-test-run-nixbot-gitlab> gitlab # [    0.337101] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]378vm-test-run-nixbot-gitlab> gitlab # [    0.337139] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]379vm-test-run-nixbot-gitlab> gitlab # [    0.338706] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint380vm-test-run-nixbot-gitlab> gitlab # [    0.339369] pci 0000:00:02.0: BAR 0 [io  0x0000-0x001f]381vm-test-run-nixbot-gitlab> gitlab # [    0.339406] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]382vm-test-run-nixbot-gitlab> gitlab # [    0.339487] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]383vm-test-run-nixbot-gitlab> gitlab # [    0.341120] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint384vm-test-run-nixbot-gitlab> gitlab # [    0.341748] pci 0000:00:03.0: BAR 0 [io  0x0000-0x001f]385vm-test-run-nixbot-gitlab> gitlab # [    0.341784] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]386vm-test-run-nixbot-gitlab> gitlab # [    0.341866] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]387vm-test-run-nixbot-gitlab> gitlab # [    0.343588] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint388vm-test-run-nixbot-gitlab> gitlab # [    0.344228] pci 0000:00:04.0: BAR 0 [io  0x0000-0x001f]389vm-test-run-nixbot-gitlab> gitlab # [    0.344263] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]390vm-test-run-nixbot-gitlab> gitlab # [    0.344345] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]391vm-test-run-nixbot-gitlab> gitlab # [    0.345936] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint392vm-test-run-nixbot-gitlab> gitlab # [    0.346565] pci 0000:00:05.0: BAR 0 [io  0x0000-0x007f]393vm-test-run-nixbot-gitlab> gitlab # [    0.346600] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]394vm-test-run-nixbot-gitlab> gitlab # [    0.346682] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]395vm-test-run-nixbot-gitlab> gitlab # [    0.348285] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint396vm-test-run-nixbot-gitlab> gitlab # [    0.348967] pci 0000:00:06.0: BAR 0 [io  0x0000-0x007f]397vm-test-run-nixbot-gitlab> gitlab # [    0.349003] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]398vm-test-run-nixbot-gitlab> gitlab # [    0.349085] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]399vm-test-run-nixbot-gitlab> gitlab # [    0.350722] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint400vm-test-run-nixbot-gitlab> gitlab # [    0.351382] pci 0000:00:07.0: BAR 0 [io  0x0000-0x001f]401vm-test-run-nixbot-gitlab> gitlab # [    0.351418] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]402vm-test-run-nixbot-gitlab> gitlab # [    0.351499] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]403vm-test-run-nixbot-gitlab> gitlab # [    0.351536] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]404vm-test-run-nixbot-gitlab> gitlab # [    0.353250] pci 0000:00:08.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint405vm-test-run-nixbot-gitlab> gitlab # [    0.353929] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]406vm-test-run-nixbot-gitlab> gitlab # [    0.354011] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]407vm-test-run-nixbot-gitlab> gitlab # [    0.355668] pci 0000:00:09.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint408vm-test-run-nixbot-gitlab> gitlab # [    0.356332] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]409vm-test-run-nixbot-gitlab> gitlab # [    0.356414] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]410vm-test-run-nixbot-gitlab> gitlab # [    0.357848] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint411vm-test-run-nixbot-gitlab> gitlab # [    0.358500] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]412vm-test-run-nixbot-gitlab> gitlab # [    0.359283] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint413vm-test-run-nixbot-gitlab> gitlab # [    0.360008] pci 0000:00:0b.0: BAR 0 [io  0x0000-0x003f]414vm-test-run-nixbot-gitlab> gitlab # [    0.360043] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]415vm-test-run-nixbot-gitlab> gitlab # [    0.360125] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]416vm-test-run-nixbot-gitlab> gitlab # [    0.361748] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint417vm-test-run-nixbot-gitlab> gitlab # [    0.362362] pci 0000:00:0c.0: BAR 0 [io  0x0000-0x001f]418vm-test-run-nixbot-gitlab> gitlab # [    0.362397] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]419vm-test-run-nixbot-gitlab> gitlab # [    0.362479] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]420vm-test-run-nixbot-gitlab> gitlab # [    0.364349] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned421vm-test-run-nixbot-gitlab> gitlab # [    0.364367] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned422vm-test-run-nixbot-gitlab> gitlab # [    0.364377] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned423vm-test-run-nixbot-gitlab> gitlab # [    0.364549] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned424vm-test-run-nixbot-gitlab> gitlab # [    0.364683] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned425vm-test-run-nixbot-gitlab> gitlab # [    0.364816] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned426vm-test-run-nixbot-gitlab> gitlab # [    0.364949] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned427vm-test-run-nixbot-gitlab> gitlab # [    0.365102] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned428vm-test-run-nixbot-gitlab> gitlab # [    0.365237] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned429vm-test-run-nixbot-gitlab> gitlab # [    0.365372] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned430vm-test-run-nixbot-gitlab> gitlab # [    0.365520] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned431vm-test-run-nixbot-gitlab> gitlab # [    0.365655] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned432vm-test-run-nixbot-gitlab> gitlab # [    0.365827] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned433vm-test-run-nixbot-gitlab> gitlab # [    0.365973] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned434vm-test-run-nixbot-gitlab> gitlab # [    0.366039] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned435vm-test-run-nixbot-gitlab> gitlab # [    0.366104] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned436vm-test-run-nixbot-gitlab> gitlab # [    0.366169] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned437vm-test-run-nixbot-gitlab> gitlab # [    0.366236] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned438vm-test-run-nixbot-gitlab> gitlab # [    0.366301] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned439vm-test-run-nixbot-gitlab> gitlab # [    0.366367] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned440vm-test-run-nixbot-gitlab> gitlab # [    0.366435] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned441vm-test-run-nixbot-gitlab> gitlab # [    0.366491] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned442vm-test-run-nixbot-gitlab> gitlab # [    0.366547] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned443vm-test-run-nixbot-gitlab> gitlab # [    0.366605] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned444vm-test-run-nixbot-gitlab> gitlab # [    0.366662] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned445vm-test-run-nixbot-gitlab> gitlab # [    0.366716] pci 0000:00:05.0: BAR 0 [io  0x1000-0x107f]: assigned446vm-test-run-nixbot-gitlab> gitlab # [    0.366769] pci 0000:00:06.0: BAR 0 [io  0x1080-0x10ff]: assigned447vm-test-run-nixbot-gitlab> gitlab # [    0.366836] pci 0000:00:0b.0: BAR 0 [io  0x1100-0x113f]: assigned448vm-test-run-nixbot-gitlab> gitlab # [    0.366913] pci 0000:00:01.0: BAR 0 [io  0x1140-0x115f]: assigned449vm-test-run-nixbot-gitlab> gitlab # [    0.366981] pci 0000:00:02.0: BAR 0 [io  0x1160-0x117f]: assigned450vm-test-run-nixbot-gitlab> gitlab # [    0.367045] pci 0000:00:03.0: BAR 0 [io  0x1180-0x119f]: assigned451vm-test-run-nixbot-gitlab> gitlab # [    0.367113] pci 0000:00:04.0: BAR 0 [io  0x11a0-0x11bf]: assigned452vm-test-run-nixbot-gitlab> gitlab # [    0.367177] pci 0000:00:07.0: BAR 0 [io  0x11c0-0x11df]: assigned453vm-test-run-nixbot-gitlab> gitlab # [    0.367244] pci 0000:00:0c.0: BAR 0 [io  0x11e0-0x11ff]: assigned454vm-test-run-nixbot-gitlab> gitlab # [    0.367319] pci_bus 0000:00: resource 4 [io  0x0000-0xffff]455vm-test-run-nixbot-gitlab> gitlab # [    0.367333] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]456vm-test-run-nixbot-gitlab> gitlab # [    0.367342] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]457vm-test-run-nixbot-gitlab> gitlab # [    0.371557] pci 0000:00:0a.0: enabling device (0000 -> 0002)458vm-test-run-nixbot-gitlab> gitlab # [    0.407197] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)459vm-test-run-nixbot-gitlab> gitlab # [    0.413158] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)460vm-test-run-nixbot-gitlab> gitlab # [    0.419248] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)461vm-test-run-nixbot-gitlab> gitlab # [    0.425744] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)462vm-test-run-nixbot-gitlab> gitlab # [    0.431888] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)463vm-test-run-nixbot-gitlab> gitlab # [    0.438889] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)464vm-test-run-nixbot-gitlab> gitlab # [    0.444971] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)465vm-test-run-nixbot-gitlab> gitlab # [    0.451802] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)466vm-test-run-nixbot-gitlab> gitlab # [    0.456806] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)467vm-test-run-nixbot-gitlab> gitlab # [    0.463286] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)468vm-test-run-nixbot-gitlab> gitlab # [    0.469670] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)469vm-test-run-nixbot-gitlab> gitlab # [    0.483920] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled470vm-test-run-nixbot-gitlab> gitlab # [    0.488146] msm_serial: driver initialized471vm-test-run-nixbot-gitlab> gitlab # [    0.488587] SuperH (H)SCI(F) driver initialized472vm-test-run-nixbot-gitlab> gitlab # [    0.488704] STM32 USART driver initialized473vm-test-run-nixbot-gitlab> gitlab # [    0.528522] loop: module loaded474vm-test-run-nixbot-gitlab> gitlab # [    0.528876] virtio_blk virtio4: 4/0/0 default/read/poll queues475vm-test-run-nixbot-gitlab> gitlab # [    0.532607] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)476vm-test-run-nixbot-gitlab> gitlab # [    0.536106] virtio_blk virtio5: 4/0/0 default/read/poll queues477vm-test-run-nixbot-gitlab> gitlab # [    0.540072] virtio_blk virtio5: [vdb] 11826936 512-byte logical blocks (6.06 GB/5.64 GiB)478vm-test-run-nixbot-gitlab> gitlab # [    0.543906] megasas: 07.734.00.00-rc1479vm-test-run-nixbot-gitlab> gitlab # [    0.545400] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]480vm-test-run-nixbot-gitlab> gitlab # [    0.549483] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000481vm-test-run-nixbot-gitlab> gitlab # [    0.549507] Intel/Sharp Extended Query Table at 0x0031482vm-test-run-nixbot-gitlab> gitlab # [    0.552537] Using buffer write method483vm-test-run-nixbot-gitlab> gitlab # [    0.552581] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]484vm-test-run-nixbot-gitlab> gitlab # [    0.556012] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000485vm-test-run-nixbot-gitlab> gitlab # [    0.556034] Intel/Sharp Extended Query Table at 0x0031486vm-test-run-nixbot-gitlab> gitlab # [    0.561174] Using buffer write method487vm-test-run-nixbot-gitlab> gitlab # [    0.561198] Concatenating MTD devices:488vm-test-run-nixbot-gitlab> gitlab # [    0.561203] (0): "0.flash"489vm-test-run-nixbot-gitlab> gitlab # [    0.561208] (1): "0.flash"490vm-test-run-nixbot-gitlab> gitlab # [    0.561212] into device "0.flash"491vm-test-run-nixbot-gitlab> gitlab # [    0.597876] Freeing initrd memory: 25372K492vm-test-run-nixbot-gitlab> gitlab # [    0.615484] tun: Universal TUN/TAP device driver, 1.6493vm-test-run-nixbot-gitlab> gitlab # [    0.624359] thunder_xcv, ver 1.0494vm-test-run-nixbot-gitlab> gitlab # [    0.624426] thunder_bgx, ver 1.0495vm-test-run-nixbot-gitlab> gitlab # [    0.624547] nicpf, ver 1.0496vm-test-run-nixbot-gitlab> gitlab # [    0.626313] e1000: Intel(R) PRO/1000 Network Driver497vm-test-run-nixbot-gitlab> gitlab # [    0.626324] e1000: Copyright (c) 1999-2006 Intel Corporation.498vm-test-run-nixbot-gitlab> gitlab # [    0.626413] e1000e: Intel(R) PRO/1000 Network Driver499vm-test-run-nixbot-gitlab> gitlab # [    0.626428] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.500vm-test-run-nixbot-gitlab> gitlab # [    0.626499] igb: Intel(R) Gigabit Ethernet Network Driver501vm-test-run-nixbot-gitlab> gitlab # [    0.626509] igb: Copyright (c) 2007-2014 Intel Corporation.502vm-test-run-nixbot-gitlab> gitlab # [    0.626571] igbvf: Intel(R) Gigabit Virtual Function Network Driver503vm-test-run-nixbot-gitlab> gitlab # [    0.626582] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.504vm-test-run-nixbot-gitlab> gitlab # [    0.627151] sky2: driver version 1.30505vm-test-run-nixbot-gitlab> gitlab # [    0.631928] usbcore: registered new interface driver usb-storage506vm-test-run-nixbot-gitlab> gitlab # [    0.632176] ehci-pci 0000:00:0a.0: EHCI Host Controller507vm-test-run-nixbot-gitlab> gitlab # [    0.632220] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1508vm-test-run-nixbot-gitlab> gitlab # [    0.632261] usbcore: registered new interface driver usbserial_generic509vm-test-run-nixbot-gitlab> gitlab # [    0.632298] usbserial: USB Serial support registered for generic510vm-test-run-nixbot-gitlab> gitlab # [    0.633015] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000511vm-test-run-nixbot-gitlab> gitlab # [    0.634049] hv_vmbus: registering driver hyperv_keyboard512vm-test-run-nixbot-gitlab> gitlab # [    0.636718] rtc-pl031 9010000.pl031: registered as rtc0513vm-test-run-nixbot-gitlab> gitlab # [    0.636776] rtc-pl031 9010000.pl031: setting system clock to 2026-06-29T22:05:47 UTC (1782770747)514vm-test-run-nixbot-gitlab> gitlab # [    0.637613] i2c_dev: i2c /dev entries driver515vm-test-run-nixbot-gitlab> gitlab # [    0.644619] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00516vm-test-run-nixbot-gitlab> gitlab # [    0.645289] hub 1-0:1.0: USB hub found517vm-test-run-nixbot-gitlab> gitlab # [    0.645299] sdhci: Secure Digital Host Controller Interface driver518vm-test-run-nixbot-gitlab> gitlab # [    0.645316] sdhci: Copyright(c) Pierre Ossman519vm-test-run-nixbot-gitlab> gitlab # [    0.645320] hub 1-0:1.0: 6 ports detected520vm-test-run-nixbot-gitlab> gitlab # [    0.646024] Synopsys Designware Multimedia Card Interface Driver521vm-test-run-nixbot-gitlab> gitlab # [    0.647013] sdhci-pltfm: SDHCI platform and OF driver helper522vm-test-run-nixbot-gitlab> gitlab # [    0.650976] hid: raw HID events driver (C) Jiri Kosina523vm-test-run-nixbot-gitlab> gitlab # [    0.651630] usbcore: registered new interface driver usbhid524vm-test-run-nixbot-gitlab> gitlab # [    0.651638] usbhid: USB HID core driver525vm-test-run-nixbot-gitlab> gitlab # [    0.677195] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available526vm-test-run-nixbot-gitlab> gitlab # [    0.681882] drop_monitor: Initializing network drop monitor service527vm-test-run-nixbot-gitlab> gitlab # [    0.682238] NET: Registered PF_INET6 protocol family528vm-test-run-nixbot-gitlab> gitlab # [    0.684369] Segment Routing with IPv6529vm-test-run-nixbot-gitlab> gitlab # [    0.684405] In-situ OAM (IOAM) with IPv6530vm-test-run-nixbot-gitlab> gitlab # [    0.684473] NET: Registered PF_PACKET protocol family531vm-test-run-nixbot-gitlab> gitlab # [    0.684833] 9pnet: Installing 9P2000 support532vm-test-run-nixbot-gitlab> gitlab # [    0.689254] Key type dns_resolver registered533vm-test-run-nixbot-gitlab> gitlab # [    0.707066] registered taskstats version 1534vm-test-run-nixbot-gitlab> gitlab # [    0.707473] Loading compiled-in X.509 certificates535vm-test-run-nixbot-gitlab> gitlab # [    0.728025] Demotion targets for Node 0: null536vm-test-run-nixbot-gitlab> gitlab # [    0.728249] Key type .fscrypt registered537vm-test-run-nixbot-gitlab> gitlab # [    0.728256] Key type fscrypt-provisioning registered538vm-test-run-nixbot-gitlab> gitlab # [    0.728409] ima: No TPM chip found, activating TPM-bypass!539vm-test-run-nixbot-gitlab> gitlab # [    0.728431] ima: Allocated hash algorithm: sha1540vm-test-run-nixbot-gitlab> gitlab # [    0.728456] ima: No architecture policies found541vm-test-run-nixbot-gitlab> gitlab # [    0.729880] input: gpio-keys as /devices/platform/gpio-keys/input/input0542vm-test-run-nixbot-gitlab> gitlab # [    0.754602] clk: Disabling unused clocks543vm-test-run-nixbot-gitlab> gitlab # [    0.754631] PM: genpd: Disabling unused power domains544vm-test-run-nixbot-gitlab> gitlab # [    0.760022] Freeing unused kernel memory: 4736K545vm-test-run-nixbot-gitlab> gitlab # [    0.760256] Run /init as init process546vm-test-run-nixbot-gitlab> gitlab # [    0.791584] systemd[1]: Successfully made /usr/ read-only.547vm-test-run-nixbot-gitlab> gitlab # [    0.892525] usb 1-1: new high-speed USB device number 2 using ehci-pci548vm-test-run-nixbot-gitlab> gitlab # [    1.049436] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1549vm-test-run-nixbot-gitlab> gitlab # [    1.126103] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)550vm-test-run-nixbot-gitlab> gitlab # [    1.126169] systemd[1]: Detected virtualization qemu.551vm-test-run-nixbot-gitlab> gitlab # [    1.126236] systemd[1]: Detected architecture arm64.552vm-test-run-nixbot-gitlab> gitlab # [    1.126252] systemd[1]: Running in initrd.553vm-test-run-nixbot-gitlab> gitlab # [    1.127225] systemd[1]: Initializing machine ID from random generator.554vm-test-run-nixbot-gitlab> gitlab # [    1.127604] systemd[1]: Hostname set to <gitlab>.555vm-test-run-nixbot-gitlab> gitlab # [    1.165268] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0556vm-test-run-nixbot-gitlab> gitlab # [    1.272069] systemd[1]: Queued start job for default target Initrd Default Target.557vm-test-run-nixbot-gitlab> gitlab # [    1.284574] usb 1-2: new high-speed USB device number 3 using ehci-pci558vm-test-run-nixbot-gitlab> gitlab # [    1.438803] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2559vm-test-run-nixbot-gitlab> gitlab # [    1.439309] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0560vm-test-run-nixbot-gitlab> gitlab # [    1.517944] systemd[1]: Created slice Slice /system/modprobe.561vm-test-run-nixbot-gitlab> gitlab # [    1.518453] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.562vm-test-run-nixbot-gitlab> gitlab # [    1.518522] systemd[1]: Expecting device /dev/disk/by-label/nix-store...563vm-test-run-nixbot-gitlab> gitlab # [    1.518551] systemd[1]: Expecting device /dev/disk/by-label/nixos...564vm-test-run-nixbot-gitlab> gitlab # [    1.518606] systemd[1]: Reached target Path Units.565vm-test-run-nixbot-gitlab> gitlab # [    1.518643] systemd[1]: Reached target Slice Units.566vm-test-run-nixbot-gitlab> gitlab # [    1.518680] systemd[1]: Reached target Swaps.567vm-test-run-nixbot-gitlab> gitlab # [    1.518717] systemd[1]: Reached target Timer Units.568vm-test-run-nixbot-gitlab> gitlab # [    1.519063] systemd[1]: Listening on D-Bus System Message Bus Socket.569vm-test-run-nixbot-gitlab> gitlab # [    1.519401] systemd[1]: Listening on Journal Socket (/dev/log).570vm-test-run-nixbot-gitlab> gitlab # [    1.519800] systemd[1]: Listening on Journal Sockets.571vm-test-run-nixbot-gitlab> gitlab # [    1.520098] systemd[1]: Listening on udev Control Socket.572vm-test-run-nixbot-gitlab> gitlab # [    1.520267] systemd[1]: Listening on udev Kernel Socket.573vm-test-run-nixbot-gitlab> gitlab # [    1.520311] systemd[1]: Reached target Socket Units.574vm-test-run-nixbot-gitlab> gitlab # [    1.527360] systemd[1]: Starting Create List of Static Device Nodes...575vm-test-run-nixbot-gitlab> gitlab # [    1.535018] systemd[1]: Starting Load Kernel Module 9pnet_virtio...576vm-test-run-nixbot-gitlab> gitlab # [    1.535170] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs577vm-test-run-nixbot-gitlab> gitlab # [    1.543004] systemd[1]: Mounting Kernel Configuration File System...578vm-test-run-nixbot-gitlab> gitlab # [    1.566559] systemd[1]: Starting Journal Service...579vm-test-run-nixbot-gitlab> gitlab # [    1.575467] systemd[1]: Starting Load Kernel Modules...580vm-test-run-nixbot-gitlab> gitlab # [    1.575617] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki581vm-test-run-nixbot-gitlab> gitlab # [    1.582749] systemd[1]: Starting Coldplug All udev Devices...582vm-test-run-nixbot-gitlab> gitlab # [    1.602627] systemd[1]: Finished Create List of Static Device Nodes.583vm-test-run-nixbot-gitlab> gitlab # [    1.604426] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.584vm-test-run-nixbot-gitlab> gitlab # [    1.614217] [drm] pci: virtio-gpu-pci detected at 0000:00:09.0585vm-test-run-nixbot-gitlab> gitlab # [    1.614759] [drm] features: -virgl +edid -resource_blob -host_visible586vm-test-run-nixbot-gitlab> gitlab # [    1.614766] [drm] features: -context_init587vm-test-run-nixbot-gitlab> gitlab # [    1.615774] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.588vm-test-run-nixbot-gitlab> gitlab # [    1.616098] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev589vm-test-run-nixbot-gitlab> gitlab # [    1.616267] [drm] number of scanouts: 1590vm-test-run-nixbot-gitlab> gitlab # [    1.616291] [drm] number of cap sets: 0591vm-test-run-nixbot-gitlab> gitlab # [    1.616432] systemd-journald[154]: Collecting audit messages is disabled.592vm-test-run-nixbot-gitlab> gitlab # [    1.616926] systemd[1]: Finished Load Kernel Module 9pnet_virtio.593vm-test-run-nixbot-gitlab> gitlab # [    1.621270] virtio-pci 0000:00:09.0: [drm] Registered 1 planes with drm panic594vm-test-run-nixbot-gitlab> gitlab # [    1.621288] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:09.0 on minor 0595vm-test-run-nixbot-gitlab> gitlab # [    1.629179] Console: switching to colour frame buffer device 160x50596vm-test-run-nixbot-gitlab> gitlab # [    1.636245] virtio-pci 0000:00:09.0: [drm] fb0: virtio_gpudrmfb frame buffer device597vm-test-run-nixbot-gitlab> gitlab # [    1.648988] systemd[1]: Mounted Kernel Configuration File System.598vm-test-run-nixbot-gitlab> gitlab # [    1.656869] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...599vm-test-run-nixbot-gitlab> gitlab # [    1.666338] systemd[1]: Finished Load Kernel Modules.600vm-test-run-nixbot-gitlab> gitlab # [    1.693126] systemd[1]: Starting Apply Kernel Variables...601vm-test-run-nixbot-gitlab> gitlab # [    1.701036] systemd[1]: Started Journal Service.602vm-test-run-nixbot-gitlab> gitlab # [    1.697099] systemd-modules-load[156]: Using 4 probe threads603vm-test-run-nixbot-gitlab> gitlab # [    1.700351] systemd-modules-load[156]: Module 'virtio_balloon' is built in604vm-test-run-nixbot-gitlab> gitlab # [    1.702332] systemd-modules-load[156]: Module 'virtio_console' is built in605vm-test-run-nixbot-gitlab> gitlab # [    1.704111] systemd-modules-load[156]: Module 'virtio_rng' is built in606vm-test-run-nixbot-gitlab> gitlab # [    1.705203] systemd-modules-load[156]: Inserted module 'dm_mod'607vm-test-run-nixbot-gitlab> gitlab # [    1.706197] systemd-modules-load[156]: Inserted module 'virtio_gpu'608vm-test-run-nixbot-gitlab> gitlab # [    1.707985] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.609vm-test-run-nixbot-gitlab> gitlab # [    1.715933] systemd[1]: Starting Create Static Device Nodes in /dev...610vm-test-run-nixbot-gitlab> gitlab # [    1.725463] systemd[1]: Finished Apply Kernel Variables.611vm-test-run-nixbot-gitlab> gitlab # [    1.758423] systemd[1]: Finished Create Static Device Nodes in /dev.612vm-test-run-nixbot-gitlab> gitlab # [    1.761629] systemd[1]: Reached target Preparation for Local File Systems.613vm-test-run-nixbot-gitlab> gitlab # [    1.763453] systemd[1]: Reached target Local File Systems.614vm-test-run-nixbot-gitlab> gitlab # [    1.768818] systemd[1]: Starting Create System Files and Directories...615vm-test-run-nixbot-gitlab> gitlab # [    1.777267] systemd[1]: Starting Rule-based Manager for Device Events and Files...616vm-test-run-nixbot-gitlab> gitlab # [    1.826251] systemd[1]: Finished Create System Files and Directories.617vm-test-run-nixbot-gitlab> gitlab # [    1.847412] systemd-udevd[193]: Using default interface naming scheme 'v260'.618vm-test-run-nixbot-gitlab> gitlab # [    1.876968] systemd[1]: Started Rule-based Manager for Device Events and Files.619vm-test-run-nixbot-gitlab> gitlab # [    1.912484] systemd[1]: Starting Virtual Console Setup...620vm-test-run-nixbot-gitlab> gitlab # [    1.967277] systemd-vconsole-setup[209]: Configuration of first virtual console was skipped, ignoring remaining ones.621vm-test-run-nixbot-gitlab> gitlab # [    1.972335] systemd[1]: Finished Virtual Console Setup.622vm-test-run-nixbot-gitlab> gitlab # [    2.334326] systemd[1]: Finished Coldplug All udev Devices.623vm-test-run-nixbot-gitlab> gitlab # [    2.337057] systemd[1]: Reached target System Initialization.624vm-test-run-nixbot-gitlab> gitlab # [    2.339625] systemd[1]: Reached target Basic System.625vm-test-run-nixbot-gitlab> gitlab # [    2.552363] (udev-worker)[198]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.626vm-test-run-nixbot-gitlab> gitlab # [    2.556926] (udev-worker)[198]: Network interface NamePolicy= disabled on kernel command line.627vm-test-run-nixbot-gitlab> gitlab # [    2.582728] systemd[1]: Found device /dev/disk/by-label/nixos.628vm-test-run-nixbot-gitlab> gitlab # [    2.588873] (udev-worker)[223]: Network interface NamePolicy= disabled on kernel command line.629vm-test-run-nixbot-gitlab> gitlab # [    2.602847] systemd[1]: Found device /dev/disk/by-label/nix-store.630vm-test-run-nixbot-gitlab> gitlab # [    2.604203] systemd[1]: Reached target Initrd Root Device.631vm-test-run-nixbot-gitlab> gitlab # [    2.606816] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...632vm-test-run-nixbot-gitlab> gitlab # [    2.659529] systemd-fsck[234]: nixos: clean, 12/65536 files, 13019/262144 blocks633vm-test-run-nixbot-gitlab> gitlab # [    2.668939] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.634vm-test-run-nixbot-gitlab> gitlab # [    2.676981] systemd[1]: Mounting /sysroot...635vm-test-run-nixbot-gitlab> gitlab # [    2.708376] EXT4-fs (vda): mounted filesystem 817e4e80-66f1-47f4-ae8c-8a18caa25209 r/w with ordered data mode. Quota mode: none.636vm-test-run-nixbot-gitlab> gitlab # [    2.706083] systemd[1]: Mounted /sysroot.637vm-test-run-nixbot-gitlab> gitlab # [    2.707526] systemd[1]: Reached target Initrd Root File System.638vm-test-run-nixbot-gitlab> gitlab # [    2.712395] systemd[1]: Starting Mountpoints Configured in the Real Root...639vm-test-run-nixbot-gitlab> gitlab # [    2.740904] systemd-sysroot-fstab-check[246]: /sysroot should be mounted in the initrd, will request daemon-reload.640vm-test-run-nixbot-gitlab> gitlab # [    2.743691] systemd[1]: Reload requested from client PID 246 ('systemd-sysroot') (unit initrd-parse-etc.service)...641vm-test-run-nixbot-gitlab> gitlab # [    2.746670] systemd[1]: Reloading...642vm-test-run-nixbot-gitlab> gitlab # [    3.046202] systemd[1]: Reloading finished in 303 ms.643vm-test-run-nixbot-gitlab> gitlab # [    3.073247] systemd-sysroot-fstab-check[246]: Requesting initrd-fs.target/start/replace...644vm-test-run-nixbot-gitlab> gitlab # [    3.169334] systemd-sysroot-fstab-check[246]: Requesting swap.target/start/replace...645vm-test-run-nixbot-gitlab> gitlab # [    3.173873] systemd[1]: Starting Load Kernel Module 9pnet_virtio...646vm-test-run-nixbot-gitlab> gitlab # [    3.175537] systemd[1]: initrd-parse-etc.service: Deactivated successfully.647vm-test-run-nixbot-gitlab> gitlab # [    3.177712] systemd[1]: Finished Mountpoints Configured in the Real Root.648vm-test-run-nixbot-gitlab> gitlab # [    3.178810] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.649vm-test-run-nixbot-gitlab> gitlab # [    3.189190] (udev-worker)[215]: mtd0ro: Failed to find and pin callout binary "/nix/store/3x4plcsrj2r4mmzis46wrmyka8g4jhi8-systemd-260.1/lib/udev/mtd_probe": No such file or directory650vm-test-run-nixbot-gitlab> gitlab # [    3.192302] (udev-worker)[215]: mtd0ro: /nix/store/3x4plcsrj2r4mmzis46wrmyka8g4jhi8-systemd-260.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory651vm-test-run-nixbot-gitlab> gitlab # [    3.195658] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.652vm-test-run-nixbot-gitlab> gitlab # [    3.197501] systemd[1]: Finished Load Kernel Module 9pnet_virtio.653vm-test-run-nixbot-gitlab> gitlab # [    3.210213] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.654vm-test-run-nixbot-gitlab> gitlab # [    3.211341] systemd[1]: Stopped Virtual Console Setup.655vm-test-run-nixbot-gitlab> gitlab # [    3.213423] systemd[1]: Stopping Virtual Console Setup...656vm-test-run-nixbot-gitlab> gitlab # [    3.216184] systemd[1]: Starting Virtual Console Setup...657vm-test-run-nixbot-gitlab> gitlab # [    3.244483] systemd-vconsole-setup[456]: Configuration of first virtual console was skipped, ignoring remaining ones.658vm-test-run-nixbot-gitlab> gitlab # [    3.247912] systemd[1]: Finished Virtual Console Setup.659vm-test-run-nixbot-gitlab> gitlab # [    3.599833] systemd[1]: Mounting /sysroot/nix/.ro-store...660vm-test-run-nixbot-gitlab> gitlab # [    3.607589] systemd[1]: Mounting /sysroot/nix/.rw-store...661vm-test-run-nixbot-gitlab> gitlab # [    3.629353] systemd[1]: Mounting /sysroot/run...662vm-test-run-nixbot-gitlab> gitlab # [    3.637832] systemd[1]: Mounting /sysroot/tmp/shared...663vm-test-run-nixbot-gitlab> gitlab # [    3.650349] systemd[1]: Mounting /sysroot/tmp/xchg...664vm-test-run-nixbot-gitlab> gitlab # [    3.668658] erofs (device vdb): mounted with root inode @ nid 128.665vm-test-run-nixbot-gitlab> gitlab # [    3.679305] systemd[1]: Mounted /sysroot/nix/.ro-store.666vm-test-run-nixbot-gitlab> gitlab # [    3.682295] systemd[1]: Mounted /sysroot/nix/.rw-store.667vm-test-run-nixbot-gitlab> gitlab # [    3.684952] systemd[1]: Mounted /sysroot/run.668vm-test-run-nixbot-gitlab> gitlab # [    3.686993] systemd[1]: Mounted /sysroot/tmp/shared.669vm-test-run-nixbot-gitlab> gitlab # [    3.689360] systemd[1]: Mounted /sysroot/tmp/xchg.670vm-test-run-nixbot-gitlab> gitlab # [    3.699963] systemd[1]: Starting rw-sysroot-nix-store.service...671vm-test-run-nixbot-gitlab> gitlab # [    3.744456] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.672vm-test-run-nixbot-gitlab> gitlab # [    3.749581] systemd[1]: Finished rw-sysroot-nix-store.service.673vm-test-run-nixbot-gitlab> gitlab # [    4.597826] systemd[1]: Mounting /sysroot/nix/store...674vm-test-run-nixbot-gitlab> gitlab # [    4.665736] systemd[1]: Mounted /sysroot/nix/store.675vm-test-run-nixbot-gitlab> gitlab # [    4.668236] systemd[1]: Reached target Initrd File Systems.676vm-test-run-nixbot-gitlab> gitlab # [    4.675304] systemd[1]: Starting Find NixOS closure...677vm-test-run-nixbot-gitlab> gitlab # [    4.683319] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...678vm-test-run-nixbot-gitlab> gitlab # [    4.723155] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.679vm-test-run-nixbot-gitlab> gitlab # [    4.727175] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.680vm-test-run-nixbot-gitlab> gitlab # [    4.749064] systemd[1]: Finished Find NixOS closure.681vm-test-run-nixbot-gitlab> gitlab # [    4.751503] systemd[1]: Reached target Initrd Default Target.682vm-test-run-nixbot-gitlab> gitlab # [    4.757983] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...683vm-test-run-nixbot-gitlab> gitlab # [    4.813679] systemd[1]: Stopped target Initrd Default Target.684vm-test-run-nixbot-gitlab> gitlab # [    4.816512] systemd[1]: Stopped target Basic System.685vm-test-run-nixbot-gitlab> gitlab # [    4.818773] systemd[1]: Stopped target Initrd Root Device.686vm-test-run-nixbot-gitlab> gitlab # [    4.821210] systemd[1]: Stopped target Path Units.687vm-test-run-nixbot-gitlab> gitlab # [    4.823410] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.688vm-test-run-nixbot-gitlab> gitlab # [    4.826808] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.689vm-test-run-nixbot-gitlab> gitlab # [    4.830249] systemd[1]: Stopped target Slice Units.690vm-test-run-nixbot-gitlab> gitlab # [    4.832478] systemd[1]: Stopped target Socket Units.691vm-test-run-nixbot-gitlab> gitlab # [    4.834679] systemd[1]: Stopped target System Initialization.692vm-test-run-nixbot-gitlab> gitlab # [    4.837265] systemd[1]: Stopped target Swaps.693vm-test-run-nixbot-gitlab> gitlab # [    4.839249] systemd[1]: Stopped target Timer Units.694vm-test-run-nixbot-gitlab> gitlab # [    4.841519] systemd[1]: dbus.socket: Deactivated successfully.695vm-test-run-nixbot-gitlab> gitlab # [    4.844076] systemd[1]: Closed D-Bus System Message Bus Socket.696vm-test-run-nixbot-gitlab> gitlab # [    4.846655] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.697vm-test-run-nixbot-gitlab> gitlab # [    4.850204] systemd[1]: Stopped Find NixOS closure.698vm-test-run-nixbot-gitlab> gitlab # [    4.852530] systemd[1]: Starting Load Kernel Module 9pnet_virtio...699vm-test-run-nixbot-gitlab> gitlab # [    4.855241] systemd[1]: Starting rw-sysroot-nix-store.service...700vm-test-run-nixbot-gitlab> gitlab # [    4.857949] systemd[1]: systemd-sysctl.service: Deactivated successfully.701vm-test-run-nixbot-gitlab> gitlab # [    4.860931] systemd[1]: Stopped Apply Kernel Variables.702vm-test-run-nixbot-gitlab> gitlab # [    4.863250] systemd[1]: systemd-modules-load.service: Deactivated successfully.703vm-test-run-nixbot-gitlab> gitlab # [    4.866451] systemd[1]: Stopped Load Kernel Modules.704vm-test-run-nixbot-gitlab> gitlab # [    4.870140] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.705vm-test-run-nixbot-gitlab> gitlab # [    4.873865] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.706vm-test-run-nixbot-gitlab> gitlab # [    4.879551] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.707vm-test-run-nixbot-gitlab> gitlab # [    4.882871] systemd[1]: Stopped Create System Files and Directories.708vm-test-run-nixbot-gitlab> gitlab # [    4.887301] systemd[1]: Stopped target Local File Systems.709vm-test-run-nixbot-gitlab> gitlab # [    4.889837] systemd[1]: Stopped target Preparation for Local File Systems.710vm-test-run-nixbot-gitlab> gitlab # [    4.892788] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.711vm-test-run-nixbot-gitlab> gitlab # [    4.895817] systemd[1]: Stopped Coldplug All udev Devices.712vm-test-run-nixbot-gitlab> gitlab # [    4.898279] systemd[1]: Stopping Rule-based Manager for Device Events and Files...713vm-test-run-nixbot-gitlab> gitlab # [    4.902804] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.714vm-test-run-nixbot-gitlab> gitlab # [    4.906021] systemd[1]: Stopped Virtual Console Setup.715vm-test-run-nixbot-gitlab> gitlab # [    4.917669] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.716vm-test-run-nixbot-gitlab> gitlab # [    4.922734] systemd[1]: Finished Load Kernel Module 9pnet_virtio.717vm-test-run-nixbot-gitlab> gitlab # [    4.933129] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.718vm-test-run-nixbot-gitlab> gitlab # [    4.937860] systemd[1]: Finished rw-sysroot-nix-store.service.719vm-test-run-nixbot-gitlab> gitlab # [    4.947421] systemd[1]: systemd-udevd.service: Deactivated successfully.720vm-test-run-nixbot-gitlab> gitlab # [    4.952686] systemd[1]: Stopped Rule-based Manager for Device Events and Files.721vm-test-run-nixbot-gitlab> gitlab # [    4.955758] systemd[1]: systemd-udevd.service: Consumed 2.419s CPU time over 3.170s wall clock time, 32.1M memory peak.722vm-test-run-nixbot-gitlab> gitlab # [    4.972149] systemd[1]: initrd-cleanup.service: Deactivated successfully.723vm-test-run-nixbot-gitlab> gitlab # [    4.977450] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.724vm-test-run-nixbot-gitlab> gitlab # [    4.990972] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.725vm-test-run-nixbot-gitlab> gitlab # [    4.994203] systemd[1]: Closed udev Control Socket.726vm-test-run-nixbot-gitlab> gitlab # [    5.006287] systemd[1]: Starting Cleanup udev Database...727vm-test-run-nixbot-gitlab> gitlab # [    5.008791] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.728vm-test-run-nixbot-gitlab> gitlab # [    5.012131] systemd[1]: Stopped Create Static Device Nodes in /dev.729vm-test-run-nixbot-gitlab> gitlab # [    5.015406] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.730vm-test-run-nixbot-gitlab> gitlab # [    5.019063] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.731vm-test-run-nixbot-gitlab> gitlab # [    5.023576] systemd[1]: kmod-static-nodes.service: Deactivated successfully.732vm-test-run-nixbot-gitlab> gitlab # [    5.026715] systemd[1]: Stopped Create List of Static Device Nodes.733vm-test-run-nixbot-gitlab> gitlab # [    5.104624] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.734vm-test-run-nixbot-gitlab> gitlab # [    5.108676] systemd[1]: Finished Cleanup udev Database.735vm-test-run-nixbot-gitlab> gitlab # [    5.117027] systemd[1]: Reached target Switch Root.736vm-test-run-nixbot-gitlab> gitlab # [    5.124900] systemd[1]: Starting NixOS Activation...737vm-test-run-nixbot-gitlab> gitlab # [    5.312793] initrd-nixos-activation-start[561]: booting system configuration /nix/store/f154ch9l48fgwkvy5y6iklk2i2fl9dp0-nixos-system-gitlab-test738vm-test-run-nixbot-gitlab> gitlab # [    5.376049] initrd-nixos-activation-start[561]: running activation script...739vm-test-run-nixbot-gitlab> gitlab # [    5.717273] initrd-nixos-activation-start[584]: setting up /etc...740vm-test-run-nixbot-gitlab> gitlab # [    5.877332] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.741vm-test-run-nixbot-gitlab> gitlab # [    5.881470] systemd[1]: Finished NixOS Activation.742vm-test-run-nixbot-gitlab> gitlab # [    5.897357] systemd[1]: Starting Switch Root...743vm-test-run-nixbot-gitlab> gitlab # [    5.952796] systemd[1]: Switching root.744vm-test-run-nixbot-gitlab> gitlab # [    6.537172] systemd-journald[154]: Received SIGTERM from PID 1 (systemd).745vm-test-run-nixbot-gitlab> gitlab # [    7.222199] systemd[1]: systemd 260.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)746vm-test-run-nixbot-gitlab> gitlab # [    7.222338] systemd[1]: Detected virtualization qemu.747vm-test-run-nixbot-gitlab> gitlab # [    7.222425] systemd[1]: Detected architecture arm64.748vm-test-run-nixbot-gitlab> gitlab # [    7.222592] systemd[1]: Detected first boot.749vm-test-run-nixbot-gitlab> gitlab # [    7.224087] systemd[1]: Initializing machine ID from random generator.750vm-test-run-nixbot-gitlab> gitlab # [    7.462001] systemd[1]: bpf-restrict-fs: LSM BPF program attached751vm-test-run-nixbot-gitlab> gitlab # [    7.563103] systemd[1]: Applying preset policy.752vm-test-run-nixbot-gitlab> gitlab # [    7.778151] systemd[1]: Populated /etc with preset unit settings.753vm-test-run-nixbot-gitlab> gitlab # [    7.926779] systemd[1]: initrd-switch-root.service: Deactivated successfully.754vm-test-run-nixbot-gitlab> gitlab # [    7.927234] systemd[1]: Stopped initrd-switch-root.service.755vm-test-run-nixbot-gitlab> gitlab # [    7.931438] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.756vm-test-run-nixbot-gitlab> gitlab # [    7.938537] systemd[1]: Created slice Slice /system/getty.757vm-test-run-nixbot-gitlab> gitlab # [    7.942298] systemd[1]: Created slice GitLab DevOps Platform Slice.758vm-test-run-nixbot-gitlab> gitlab # [    7.946469] systemd[1]: Created slice User and Session Slice.759vm-test-run-nixbot-gitlab> gitlab # [    7.947919] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.760vm-test-run-nixbot-gitlab> gitlab # [    7.949335] systemd[1]: Started Forward Password Requests to Wall Directory Watch.761vm-test-run-nixbot-gitlab> gitlab # [    7.950454] systemd[1]: Expecting device /dev/hvc0...762vm-test-run-nixbot-gitlab> gitlab # [    7.951547] systemd[1]: Expecting device /dev/ttyAMA0...763vm-test-run-nixbot-gitlab> gitlab # [    7.952716] systemd[1]: Reached target Local Encrypted Volumes.764vm-test-run-nixbot-gitlab> gitlab # [    7.953824] systemd[1]: Stopped target initrd-fs.target.765vm-test-run-nixbot-gitlab> gitlab # [    7.954903] systemd[1]: Stopped target initrd-root-fs.target.766vm-test-run-nixbot-gitlab> gitlab # [    7.955963] systemd[1]: Stopped target initrd-switch-root.target.767vm-test-run-nixbot-gitlab> gitlab # [    7.957080] systemd[1]: Reached target Virtual Machines and Containers.768vm-test-run-nixbot-gitlab> gitlab # [    7.958197] systemd[1]: Reached target Path Units.769vm-test-run-nixbot-gitlab> gitlab # [    7.959293] systemd[1]: Reached target Remote File Systems.770vm-test-run-nixbot-gitlab> gitlab # [    7.960335] systemd[1]: Reached target Slice Units.771vm-test-run-nixbot-gitlab> gitlab # [    7.961426] systemd[1]: Reached target Swaps.772vm-test-run-nixbot-gitlab> gitlab # [    7.965573] systemd[1]: Listening on Process Core Dump Socket.773vm-test-run-nixbot-gitlab> gitlab # [    7.968615] systemd[1]: Listening on Credential Encryption/Decryption.774vm-test-run-nixbot-gitlab> gitlab # [    7.976698] systemd[1]: Starting Journal Log Access Socket...775vm-test-run-nixbot-gitlab> gitlab # [    7.978378] systemd[1]: Listening on Journal Audit Socket.776vm-test-run-nixbot-gitlab> gitlab # [    7.979115] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.777vm-test-run-nixbot-gitlab> gitlab # [    7.979445] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki778vm-test-run-nixbot-gitlab> gitlab # [    7.979875] systemd[1]: Listening on udev Control Socket.779vm-test-run-nixbot-gitlab> gitlab # [    7.985664] systemd[1]: Mounting Huge Pages File System...780vm-test-run-nixbot-gitlab> gitlab # [    7.991870] systemd[1]: Mounting POSIX Message Queue File System...781vm-test-run-nixbot-gitlab> gitlab # [    7.999588] systemd[1]: Mounting Kernel Debug File System...782vm-test-run-nixbot-gitlab> gitlab # [    8.011569] systemd[1]: Mounting Kernel Trace File System...783vm-test-run-nixbot-gitlab> gitlab # [    8.024783] systemd[1]: Starting Create List of Static Device Nodes...784vm-test-run-nixbot-gitlab> gitlab # [    8.033113] systemd[1]: Starting Load Kernel Module 9pnet_virtio...785vm-test-run-nixbot-gitlab> gitlab # [    8.034072] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs786vm-test-run-nixbot-gitlab> gitlab # [    8.042139] systemd[1]: Mounting Kernel Configuration File System...787vm-test-run-nixbot-gitlab> gitlab # [    8.042921] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm788vm-test-run-nixbot-gitlab> gitlab # [    8.043691] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore789vm-test-run-nixbot-gitlab> gitlab # [    8.051488] systemd[1]: Starting Load Kernel Module fuse...790vm-test-run-nixbot-gitlab> gitlab # [    8.052350] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67791vm-test-run-nixbot-gitlab> gitlab # [    8.065599] systemd[1]: Starting Journal Service...792vm-test-run-nixbot-gitlab> gitlab # [    8.069465] systemd[1]: Starting Load Kernel Modules...793vm-test-run-nixbot-gitlab> gitlab # [    8.074114] fuse: init (API version 7.45)794vm-test-run-nixbot-gitlab> gitlab # [    8.077726] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...795vm-test-run-nixbot-gitlab> gitlab # [    8.084777] systemd[1]: Starting Remount Root and Kernel File Systems...796vm-test-run-nixbot-gitlab> gitlab # [    8.085612] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki797vm-test-run-nixbot-gitlab> gitlab # [    8.100670] systemd[1]: Starting Coldplug All udev Devices...798vm-test-run-nixbot-gitlab> gitlab # [    8.105924] systemd[1]: Listening on Journal Log Access Socket.799vm-test-run-nixbot-gitlab> gitlab # [    8.111837] systemd[1]: Mounted Huge Pages File System.800vm-test-run-nixbot-gitlab> gitlab # [    8.112387] systemd[1]: Mounted POSIX Message Queue File System.801vm-test-run-nixbot-gitlab> gitlab # [    8.113128] systemd[1]: Mounted Kernel Debug File System.802vm-test-run-nixbot-gitlab> gitlab # [    8.114833] systemd[1]: Mounted Kernel Trace File System.803vm-test-run-nixbot-gitlab> gitlab # [    8.115753] systemd[1]: Finished Create List of Static Device Nodes.804vm-test-run-nixbot-gitlab> gitlab # [    8.116574] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.805vm-test-run-nixbot-gitlab> gitlab # [    8.117310] systemd[1]: Finished Load Kernel Module 9pnet_virtio.806vm-test-run-nixbot-gitlab> gitlab # [    8.117908] systemd[1]: Mounted Kernel Configuration File System.807vm-test-run-nixbot-gitlab> gitlab # [    8.118680] systemd[1]: modprobe@fuse.service: Deactivated successfully.808vm-test-run-nixbot-gitlab> gitlab # [    8.119413] systemd[1]: Finished Load Kernel Module fuse.809vm-test-run-nixbot-gitlab> gitlab # [    8.120388] systemd[1]: Finished Load Kernel Modules.810vm-test-run-nixbot-gitlab> gitlab # [    8.125516] systemd[1]: Mounting FUSE Control File System...811vm-test-run-nixbot-gitlab> gitlab # [    8.130841] systemd-journald[793]: Collecting audit messages is enabled.812vm-test-run-nixbot-gitlab> gitlab # [    8.136384] systemd[1]: Starting Firewall...813vm-test-run-nixbot-gitlab> gitlab # [    8.141017] EXT4-fs (vda): re-mounted 817e4e80-66f1-47f4-ae8c-8a18caa25209.814vm-test-run-nixbot-gitlab> gitlab # [    8.145864] systemd[1]: Starting Apply Kernel Variables...815vm-test-run-nixbot-gitlab> gitlab # [    8.163606] systemd[1]: Queued start job for default target Multi-User System.816vm-test-run-nixbot-gitlab> gitlab # [    8.166475] systemd[1]: Unnecessary job was removed for /dev/vdb.[    8.172634] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...817vm-test-run-nixbot-gitlab> gitlab # [    8.174768] systemd[1]: Started Journal Service.818vm-test-run-nixbot-gitlab> gitlab # 819vm-test-run-nixbot-gitlab> gitlab # [    8.173743] systemd[1]: systemd-journald.service: Deactivated successfully.820vm-test-run-nixbot-gitlab> gitlab # [    8.177978] systemd-modules-load[794]: Using 3 probe threads821vm-test-run-nixbot-gitlab> gitlab # [    8.181532] systemd-modules-load[794]: Module 'atkbd' is built in822vm-test-run-nixbot-gitlab> gitlab # [    8.184587] systemd-modules-load[794]: Module 'loop' is built in823vm-test-run-nixbot-gitlab> gitlab # [    8.187149] systemd-modules-load[794]: Inserted module 'tls'824vm-test-run-nixbot-gitlab> gitlab # [    8.189919] systemd[1]: Finished Remount Root and Kernel File Systems.825vm-test-run-nixbot-gitlab> gitlab # [    8.193315] systemd-oomd[796]: No swap; memory pressure usage will be degraded826vm-test-run-nixbot-gitlab> gitlab # [    8.196681] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.827vm-test-run-nixbot-gitlab> gitlab # [    8.199678] systemd[1]: Mounted FUSE Control File System.828vm-test-run-nixbot-gitlab> gitlab # [    8.201779] systemd[1]: Finished Apply Kernel Variables.829vm-test-run-nixbot-gitlab> gitlab # [    8.203735] systemd[1]: Starting Flush Journal to Persistent Storage...830vm-test-run-nixbot-gitlab> gitlab # [    8.206137] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore831vm-test-run-nixbot-gitlab> gitlab # [    8.214242] systemd-journald[793]: Received client request to flush runtime journal.832vm-test-run-nixbot-gitlab> gitlab # [    8.249550] systemd[1]: Starting Load/Save OS Random Seed...833vm-test-run-nixbot-gitlab> gitlab # [    8.252125] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki834vm-test-run-nixbot-gitlab> gitlab # [    8.255368] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.835vm-test-run-nixbot-gitlab> gitlab # [    8.257165] systemd[1]: Starting Create Static Device Nodes in /dev...836vm-test-run-nixbot-gitlab> gitlab # [    8.259619] systemd[1]: Finished Load/Save OS Random Seed.837vm-test-run-nixbot-gitlab> gitlab # [    8.262372] systemd[1]: Reached target First Boot Complete.838vm-test-run-nixbot-gitlab> gitlab # [    8.263670] systemd[1]: Finished Create Static Device Nodes in /dev.839vm-test-run-nixbot-gitlab> gitlab # [    8.265951] systemd[1]: Reached target Preparation for Local File Systems.840vm-test-run-nixbot-gitlab> gitlab # [    8.267321] systemd[1]: Starting Rule-based Manager for Device Events and Files...841vm-test-run-nixbot-gitlab> gitlab # [    8.269251] systemd[1]: Finished Flush Journal to Persistent Storage.842vm-test-run-nixbot-gitlab> gitlab # [    8.295522] systemd-udevd[831]: Using default interface naming scheme 'v260'.843vm-test-run-nixbot-gitlab> gitlab # [    8.346038] systemd[1]: Started Rule-based Manager for Device Events and Files.844vm-test-run-nixbot-gitlab> gitlab # [    8.610803] systemd[1]: Finished Firewall.845vm-test-run-nixbot-gitlab> gitlab # [    8.855435] systemd[1]: Finished Coldplug All udev Devices.846vm-test-run-nixbot-gitlab> gitlab # [    8.929035] systemd[1]: Mounting /run/wrappers...847vm-test-run-nixbot-gitlab> gitlab # [    8.950048] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs848vm-test-run-nixbot-gitlab> gitlab # [    8.963925] systemd[1]: Mounted /run/wrappers.849vm-test-run-nixbot-gitlab> gitlab # [    8.972188] systemd[1]: Reached target Local File Systems.850vm-test-run-nixbot-gitlab> gitlab # [    8.974924] systemd[1]: Listening on Boot Loader Control Service Socket.851vm-test-run-nixbot-gitlab> gitlab # [    8.985707] systemd[1]: Starting register-nix-paths.service...852vm-test-run-nixbot-gitlab> gitlab # [    8.992813] systemd[1]: Starting Create SUID/SGID Wrappers...853vm-test-run-nixbot-gitlab> gitlab # [    8.996475] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.854vm-test-run-nixbot-gitlab> gitlab # [    9.018545] systemd[1]: Starting Save Transient machine-id to Disk...855vm-test-run-nixbot-gitlab> gitlab # [    9.026268] systemd[1]: Starting Create System Files and Directories...856vm-test-run-nixbot-gitlab> gitlab # [    9.057493] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.857vm-test-run-nixbot-gitlab> gitlab # [    9.089587] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.858vm-test-run-nixbot-gitlab> gitlab # [    9.096102] systemd[1]: Finished Save Transient machine-id to Disk.859vm-test-run-nixbot-gitlab> gitlab # [    9.099300] systemd[1]: Finished Create System Files and Directories.860vm-test-run-nixbot-gitlab> gitlab # [    9.126800] (udev-worker)[947]: Network interface NamePolicy= disabled on kernel command line.861vm-test-run-nixbot-gitlab> gitlab # [    9.130791] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.862vm-test-run-nixbot-gitlab> gitlab # [    9.135461] systemd[1]: Starting Rebuild Journal Catalog...863vm-test-run-nixbot-gitlab> gitlab # [    9.139704] systemd[1]: Starting Record System Boot/Shutdown in UTMP...864vm-test-run-nixbot-gitlab> gitlab # [    9.145289] (udev-worker)[948]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.865vm-test-run-nixbot-gitlab> gitlab # [    9.150086] (udev-worker)[948]: Network interface NamePolicy= disabled on kernel command line.866vm-test-run-nixbot-gitlab> gitlab # [    9.172554] systemd[1]: Finished Record System Boot/Shutdown in UTMP.867vm-test-run-nixbot-gitlab> gitlab # [    9.193074] systemd[1]: Finished Rebuild Journal Catalog.868vm-test-run-nixbot-gitlab> gitlab # [    9.196793] systemd[1]: Starting Update is Completed...869vm-test-run-nixbot-gitlab> gitlab # [    9.204119] systemd[1]: Condition check resulted in Virtio network device being skipped.870vm-test-run-nixbot-gitlab> gitlab # [    9.205731] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore871vm-test-run-nixbot-gitlab> gitlab # [    9.207573] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.872vm-test-run-nixbot-gitlab> gitlab # [    9.209737] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67873vm-test-run-nixbot-gitlab> gitlab # [    9.212345] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore874vm-test-run-nixbot-gitlab> gitlab # [    9.215660] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki875vm-test-run-nixbot-gitlab> gitlab # [    9.217449] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-uki876vm-test-run-nixbot-gitlab> gitlab # [    9.225056] systemd[1]: Finished Update is Completed.877vm-test-run-nixbot-gitlab> gitlab # [    9.258724] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.878vm-test-run-nixbot-gitlab> gitlab # [    9.260100] systemd[1]: Finished Create SUID/SGID Wrappers.879vm-test-run-nixbot-gitlab> gitlab # [    9.261591] systemd[1]: suid-sgid-wrappers.service: Consumed 173ms CPU time over 266ms wall clock time, 6.7M memory peak, 2.2M read from disk.880vm-test-run-nixbot-gitlab> gitlab # [    9.283905] mousedev: PS/2 mouse device common for all mice881vm-test-run-nixbot-gitlab> gitlab # [    9.519900] systemd[1]: Finished register-nix-paths.service.882vm-test-run-nixbot-gitlab> gitlab # [    9.522179] systemd[1]: Reached target System Initialization.883vm-test-run-nixbot-gitlab> gitlab # [    9.524252] systemd[1]: Started Discard unused filesystem blocks once a week.884vm-test-run-nixbot-gitlab> gitlab # [    9.525822] systemd[1]: Started logrotate.timer.885vm-test-run-nixbot-gitlab> gitlab # [    9.527174] systemd[1]: Started Daily Cleanup of Temporary Directories.886vm-test-run-nixbot-gitlab> gitlab # [    9.528277] systemd[1]: Reached target Timer Units.887vm-test-run-nixbot-gitlab> gitlab # [    9.529217] systemd[1]: Listening on D-Bus System Message Bus Socket.888vm-test-run-nixbot-gitlab> gitlab # [    9.530738] systemd[1]: Listening on Nix Daemon Socket.889vm-test-run-nixbot-gitlab> gitlab # [    9.541560] systemd[1]: Starting nixbot CI service socket...890vm-test-run-nixbot-gitlab> gitlab # [    9.542714] systemd[1]: Listening on Hostname Service Socket.891vm-test-run-nixbot-gitlab> gitlab # [    9.545350] systemd[1]: Listening on nixbot CI service socket.892vm-test-run-nixbot-gitlab> gitlab # [    9.546977] systemd[1]: Reached target Socket Units.893vm-test-run-nixbot-gitlab> gitlab # [    9.549018] systemd[1]: Starting D-Bus System Message Bus...894vm-test-run-nixbot-gitlab> gitlab # [    9.585633] dbus-broker-launch[1045]: Looking up NSS user entry for 'systemd-timesync'...895vm-test-run-nixbot-gitlab> gitlab # [    9.589870] dbus-broker-launch[1045]: NSS returned no entry for 'systemd-timesync'896vm-test-run-nixbot-gitlab> gitlab # [    9.591767] dbus-broker-launch[1045]: Invalid user-name in /nix/store/ifm9k575wb3j66gvjx1xkdmmknzqr8v8-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"897vm-test-run-nixbot-gitlab> gitlab # [    9.596699] systemd[1]: Started D-Bus System Message Bus.898vm-test-run-nixbot-gitlab> gitlab # [    9.604988] dbus-broker-launch[1045]: Ready899vm-test-run-nixbot-gitlab> gitlab # [    9.605929] systemd[1]: Reached target Basic System.900vm-test-run-nixbot-gitlab> gitlab # [    9.607590] systemd[1]: Started backdoor.service.901vm-test-run-nixbot-gitlab> gitlab # [    9.610618] systemd[1]: Starting gitlab-config.service...902vm-test-run-nixbot-gitlab> gitlab # [    9.611809] systemd[1]: Starting Import lastlog data into lastlog2 database...903vm-test-run-nixbot-gitlab> gitlab # [    9.618819] systemd[1]: Starting Logrotate configuration check...904vm-test-run-nixbot-gitlab> gitlab # [    9.631512] systemd[1]: Starting Name Service Cache Daemon (nsncd)...905vm-test-run-nixbot-gitlab> gitlab # [    9.636666] systemd[1]: Starting Post-Boot Actions...906vm-test-run-nixbot-gitlab> gitlab # [    9.639876] logrotate[1050]: warning: logrotate in debug mode does nothing except printing debug messages!  Consider using verbose mode (-v) instead if this is not what you want.907vm-test-run-nixbot-gitlab> gitlab # [    9.644327] logrotate[1050]: reading config file /nix/store/hk6ay5j24mh4h8mpr5rxlxxxp8v61fnj-logrotate.conf908vm-test-run-nixbot-gitlab> gitlab # [    9.648128] logrotate[1050]: note: 'monthly' overrides previously specified 'weekly'909vm-test-run-nixbot-gitlab> gitlab # [    9.649324] logrotate[1050]: Reading state from file: /var/lib/logrotate.status910vm-test-run-nixbot-gitlab> gitlab # [    9.651405] logrotate[1050]: state file /var/lib/logrotate.status does not exist911vm-test-run-nixbot-gitlab> gitlab # [    9.654062] logrotate[1050]: Allocating hash table for state file, size 64 entries912vm-test-run-nixbot-gitlab> gitlab # connecting to host...913vm-test-run-nixbot-gitlab> gitlab # [    9.656286] logrotate[1050]: Handling 4 logs914vm-test-run-nixbot-gitlab> gitlab # [    9.657665] logrotate[1050]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed915vm-test-run-nixbot-gitlab> gitlab # [    9.659896] logrotate[1050]: considering log /var/log/btmp916vm-test-run-nixbot-gitlab> gitlab # [    9.661731] logrotate[1050]: Creating new state917vm-test-run-nixbot-gitlab> gitlab # [    9.662768] logrotate[1050]:   Now: 2026-06-29 22:05918vm-test-run-nixbot-gitlab> gitlab # [    9.663524] logrotate[1050]:   Last rotated at 2026-06-29 22:00919vm-test-run-nixbot-gitlab> gitlab # [    9.665721] logrotate[1050]:   log does not need rotating (log has already been rotated)920vm-test-run-nixbot-gitlab> gitlab: Guest shell says: b'Spawning backdoor root shell...\n'921vm-test-run-nixbot-gitlab> gitlab: connected to guest root shell922vm-test-run-nixbot-gitlab> gitlab: (connecting took 10.13 seconds)923vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for the VM to finish booting, in 10.13 seconds)924vm-test-run-nixbot-gitlab> gitlab # [    9.667049] logrotate[1050]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed925vm-test-run-nixbot-gitlab> gitlab # [    9.670277] logrotate[1050]: considering log /var/log/wtmp926vm-test-run-nixbot-gitlab> gitlab # [    9.671028] logrotate[1050]: Creating new state927vm-test-run-nixbot-gitlab> gitlab # [    9.671614] logrotate[1050]:   Now: 2026-06-29 22:05928vm-test-run-nixbot-gitlab> gitlab # [    9.672282] logrotate[1050]:   Last rotated at 2026-06-29 22:00929vm-test-run-nixbot-gitlab> gitlab # [    9.673033] logrotate[1050]:   log does not need rotating (log has already been rotated)930vm-test-run-nixbot-gitlab> gitlab # [    9.674084] logrotate[1050]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed931vm-test-run-nixbot-gitlab> gitlab # [    9.675815] logrotate[1050]: switching euid from 0 to 165 and egid from 0 to 165 (pid 1050)932vm-test-run-nixbot-gitlab> gitlab # [    9.678046] logrotate[1050]: considering log /var/gitlab/state/log/*.log933vm-test-run-nixbot-gitlab> gitlab # [    9.678917] logrotate[1050]:   log /var/gitlab/state/log/*.log does not exist -- skipping934vm-test-run-nixbot-gitlab> gitlab # [    9.679910] logrotate[1050]: Creating new state935vm-test-run-nixbot-gitlab> gitlab # [    9.682151] logrotate[1050]: switching euid from 165 to 0 and egid from 165 to 0 (pid 1050)936vm-test-run-nixbot-gitlab> gitlab # [    9.683234] logrotate[1050]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed937vm-test-run-nixbot-gitlab> gitlab # [    9.685842] logrotate[1050]: switching euid from 0 to 60 and egid from 0 to 60 (pid 1050)938vm-test-run-nixbot-gitlab> gitlab # [    9.686886] logrotate[1050]: considering log /var/log/nginx/*.log939vm-test-run-nixbot-gitlab> gitlab # [    9.688799] logrotate[1050]:   log /var/log/nginx/*.log does not exist -- skipping940vm-test-run-nixbot-gitlab> gitlab # [    9.689913] logrotate[1050]: Creating new state941vm-test-run-nixbot-gitlab> gitlab # [    9.690555] logrotate[1050]: switching euid from 60 to 0 and egid from 60 to 0 (pid 1050)942vm-test-run-nixbot-gitlab> gitlab # [    9.694960] systemd[1]: Started Reset console on configuration changes.943vm-test-run-nixbot-gitlab> gitlab # [    9.696000] systemd[1]: Starting resolvconf update...944vm-test-run-nixbot-gitlab> gitlab # [    9.697806] systemd[1]: Finished Logrotate configuration check.945vm-test-run-nixbot-gitlab> gitlab # [    9.698834] systemd[1]: Finished Post-Boot Actions.946vm-test-run-nixbot-gitlab> gitlab # [    9.701514] systemd[1]: Finished Import lastlog data into lastlog2 database.947vm-test-run-nixbot-gitlab> gitlab # [    9.710993] nsncd[1051]: Jun 29 22:05:56.578 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"948vm-test-run-nixbot-gitlab> gitlab # [    9.713266] systemd[1]: Started Name Service Cache Daemon (nsncd).949vm-test-run-nixbot-gitlab> gitlab # [    9.715209] systemd[1]: Reached target Host and Network Name Lookups.950vm-test-run-nixbot-gitlab> gitlab # [    9.716787] systemd[1]: Reached target User and Group Name Lookups.951vm-test-run-nixbot-gitlab> gitlab # [    9.720874] systemd[1]: Starting User Login Management...952vm-test-run-nixbot-gitlab> gitlab # [    9.762691] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:08.0/virtio7/input/input3953vm-test-run-nixbot-gitlab> gitlab # [    9.802268] systemd-logind[1100]: New seat seat0.954vm-test-run-nixbot-gitlab> gitlab # [    9.803132] systemd-logind[1100]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)955vm-test-run-nixbot-gitlab> gitlab # [    9.804472] systemd-logind[1100]: Watching system buttons on /dev/input/event0 (gpio-keys)956vm-test-run-nixbot-gitlab> gitlab # [    9.805665] systemd[1]: Started User Login Management.957vm-test-run-nixbot-gitlab> gitlab # [    9.806428] systemd[1]: Starting linger-users.service...958vm-test-run-nixbot-gitlab> gitlab # [    9.829075] systemd[1]: Stopped target Host and Network Name Lookups.959vm-test-run-nixbot-gitlab> gitlab # [    9.830059] systemd[1]: Stopping Host and Network Name Lookups...960vm-test-run-nixbot-gitlab> gitlab # [    9.830939] systemd[1]: Stopped target User and Group Name Lookups.961vm-test-run-nixbot-gitlab> gitlab # [    9.835352] systemd[1]: Stopping User and Group Name Lookups...962vm-test-run-nixbot-gitlab> gitlab # [    9.836598] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...963vm-test-run-nixbot-gitlab> gitlab # [    9.837521] systemd[1]: nscd.service: Deactivated successfully.964vm-test-run-nixbot-gitlab> gitlab # [    9.839296] systemd[1]: Stopped Name Service Cache Daemon (nsncd).965vm-test-run-nixbot-gitlab> gitlab # [    9.840321] systemd[1]: nscd.service: Consumed 27ms CPU time over 204ms wall clock time, 8.2M memory peak, 5.9M read from disk.966vm-test-run-nixbot-gitlab> gitlab # [    9.848470] systemd[1]: Starting Name Service Cache Daemon (nsncd)...967vm-test-run-nixbot-gitlab> gitlab # [    9.850522] systemd[1]: linger-users.service: Deactivated successfully.968vm-test-run-nixbot-gitlab> gitlab # [    9.853307] systemd[1]: Finished linger-users.service.969vm-test-run-nixbot-gitlab> gitlab # [    9.877542] systemd[1]: Finished resolvconf update.970vm-test-run-nixbot-gitlab> gitlab # [    9.880620] systemd[1]: Reached target Preparation for Network.971vm-test-run-nixbot-gitlab> gitlab # [    9.890302] systemd[1]: Starting DHCP Client...972vm-test-run-nixbot-gitlab> gitlab # [    9.891394] nsncd[1139]: Jun 29 22:05:56.756 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"973vm-test-run-nixbot-gitlab> gitlab # [    9.896136] systemd[1]: Starting Address configuration of eth1...974vm-test-run-nixbot-gitlab> gitlab # [    9.897463] systemd[1]: Starting Extra networking commands....975vm-test-run-nixbot-gitlab> gitlab # [    9.898638] systemd[1]: Started Name Service Cache Daemon (nsncd).976vm-test-run-nixbot-gitlab> gitlab # [    9.900745] systemd[1]: Reached target Host and Network Name Lookups.977vm-test-run-nixbot-gitlab> gitlab # [    9.901728] systemd[1]: Reached target User and Group Name Lookups.978vm-test-run-nixbot-gitlab> gitlab # [    9.953563] network-addresses-eth1-start[1165]: adding address 192.168.1.1/24... done979vm-test-run-nixbot-gitlab> gitlab # [    9.958903] network-addresses-eth1-start[1165]: adding address 2001:db8:1::1/64... done980vm-test-run-nixbot-gitlab> gitlab # [    9.968206] systemd[1]: Finished Address configuration of eth1.981vm-test-run-nixbot-gitlab> gitlab # [    9.975517] systemd[1]: Starting Virtual Console Setup...982vm-test-run-nixbot-gitlab> gitlab # [   10.001690] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.983vm-test-run-nixbot-gitlab> gitlab # [   10.002933] systemd[1]: Stopped Virtual Console Setup.984vm-test-run-nixbot-gitlab> gitlab # [   10.008592] systemd[1]: Starting Virtual Console Setup...985vm-test-run-nixbot-gitlab> gitlab # [   10.018649] systemd-logind[1100]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)986vm-test-run-nixbot-gitlab> gitlab # [   10.036516] systemd[1]: Finished Extra networking commands..987vm-test-run-nixbot-gitlab> gitlab # [   10.037414] systemd[1]: Reached target Network.988vm-test-run-nixbot-gitlab> gitlab # [   10.039634] systemd[1]: Starting gitlab-workhorse.service...989vm-test-run-nixbot-gitlab> gitlab # [   10.042427] systemd[1]: Starting Nginx Web Server...990vm-test-run-nixbot-gitlab> gitlab # [   10.045018] dhcpcd[1191]: dhcpcd-10.3.2 starting991vm-test-run-nixbot-gitlab> gitlab # [   10.045773] systemd[1]: Starting PostgreSQL Server...992vm-test-run-nixbot-gitlab> gitlab # [   10.052566] dhcpcd[1232]: dev: loaded udev993vm-test-run-nixbot-gitlab> gitlab # [   10.053259] systemd[1]: Starting Redis Server - redis-gitlab...994vm-test-run-nixbot-gitlab> gitlab # [   10.059454] systemd[1]: Starting Permit User Sessions...995vm-test-run-nixbot-gitlab> gitlab # [   10.070911] 8021q: 802.1Q VLAN Support v1.8996vm-test-run-nixbot-gitlab> gitlab # [   10.071257] 8021q: adding VLAN 0 to HW filter on device eth1997vm-test-run-nixbot-gitlab> gitlab # [   10.079088] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.998vm-test-run-nixbot-gitlab> gitlab # [   10.083910] systemd-vconsole-setup[1213]: Configuration of first virtual console was skipped, ignoring remaining ones.999vm-test-run-nixbot-gitlab> gitlab # [   10.089479] systemd[1]: Finished Virtual Console Setup.1000vm-test-run-nixbot-gitlab> gitlab # [   10.097791] systemd[1]: Finished Permit User Sessions.1001vm-test-run-nixbot-gitlab> gitlab # [   10.107725] systemd[1]: Started Getty on tty1.1002vm-test-run-nixbot-gitlab> gitlab # [   10.108958] systemd[1]: Reached target Login Prompts.1003vm-test-run-nixbot-gitlab> gitlab # [   10.121551] cfg80211: Loading compiled-in X.509 certificates for regulatory database1004vm-test-run-nixbot-gitlab> gitlab # [   10.129139] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'1005vm-test-run-nixbot-gitlab> gitlab # [   10.129601] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'1006vm-test-run-nixbot-gitlab> gitlab # [   10.130998] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -21007vm-test-run-nixbot-gitlab> gitlab # [   10.131305] cfg80211: failed to load regulatory.db1008vm-test-run-nixbot-gitlab> gitlab # [   10.170469] 8021q: adding VLAN 0 to HW filter on device eth01009vm-test-run-nixbot-gitlab> gitlab # [   10.167193] dhcpcd[1232]: eth0: waiting for carrier1010vm-test-run-nixbot-gitlab> gitlab # [   10.175913] dhcpcd[1232]: eth0: carrier acquired1011vm-test-run-nixbot-gitlab> gitlab # [   10.179978] dhcpcd[1232]: DUID 00:01:00:01:31:d5:a8:c5:52:54:00:12:34:561012vm-test-run-nixbot-gitlab> gitlab # [   10.181417] dhcpcd[1232]: eth0: IAID 00:12:34:561013vm-test-run-nixbot-gitlab> gitlab # [   10.182153] dhcpcd[1232]: eth0: adding address fe80::5054:ff:fe12:34561014vm-test-run-nixbot-gitlab> gitlab # [   10.222364] redis-server[1256]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.1015vm-test-run-nixbot-gitlab> gitlab # [   10.227663] redis-server[1256]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo1016vm-test-run-nixbot-gitlab> gitlab # [   10.231888] systemd[1]: Started Redis Server - redis-gitlab.1017vm-test-run-nixbot-gitlab> gitlab # [   10.233333] redis-server[1256]: Redis version=8.8.0, bits=64, commit=00000000, modified=0, pid=1256, just started1018vm-test-run-nixbot-gitlab> gitlab # [   10.235968] nginx-pre-start[1262]: nginx: the configuration file /nix/store/2526shpjv0bzachwf4qi968gxiiyv4kq-nginx.conf syntax is ok1019vm-test-run-nixbot-gitlab> gitlab # [   10.238116] nginx-pre-start[1262]: nginx: configuration file /nix/store/2526shpjv0bzachwf4qi968gxiiyv4kq-nginx.conf test is successful1020vm-test-run-nixbot-gitlab> gitlab # [   10.240253] systemd[1]: Started Nginx Web Server.1021vm-test-run-nixbot-gitlab> gitlab # [   10.241040] redis-server[1256]: Configuration loaded1022vm-test-run-nixbot-gitlab> gitlab # [   10.242021] redis[1256]: monotonic clock: ARM CNTVCT @ 1000 ticks/us1023vm-test-run-nixbot-gitlab> gitlab # [   10.243338] redis[1256]: Running mode=standalone, port=0.1024vm-test-run-nixbot-gitlab> gitlab # [   10.244599] redis[1256]: Server initialized1025vm-test-run-nixbot-gitlab> gitlab # [   10.245416] redis[1256]: Ready to accept connections unix1026vm-test-run-nixbot-gitlab> gitlab # [   10.246331] redis[1256]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.1027vm-test-run-nixbot-gitlab> gitlab # [   10.264364] postgresql-pre-start[1267]: The files belonging to this database system will be owned by user "postgres".1028vm-test-run-nixbot-gitlab> gitlab # [   10.266556] postgresql-pre-start[1267]: This user must also own the server process.1029vm-test-run-nixbot-gitlab> gitlab # [   10.268425] postgresql-pre-start[1267]: The database cluster will be initialized with locale "en_US.UTF-8".1030vm-test-run-nixbot-gitlab> gitlab # [   10.269972] postgresql-pre-start[1267]: The default database encoding has accordingly been set to "UTF8".1031vm-test-run-nixbot-gitlab> gitlab # [   10.271232] postgresql-pre-start[1267]: The default text search configuration will be set to "english".1032vm-test-run-nixbot-gitlab> gitlab # [   10.272578] postgresql-pre-start[1267]: Data page checksums are disabled.1033vm-test-run-nixbot-gitlab> gitlab # [   10.273529] postgresql-pre-start[1267]: fixing permissions on existing directory /var/lib/postgresql/17 ... ok1034vm-test-run-nixbot-gitlab> gitlab # [   10.274982] postgresql-pre-start[1267]: creating subdirectories ... ok1035vm-test-run-nixbot-gitlab> gitlab # [   10.275912] postgresql-pre-start[1267]: selecting dynamic shared memory implementation ... posix1036vm-test-run-nixbot-gitlab> gitlab # [   10.310066] postgresql-pre-start[1267]: selecting default "max_connections" ... 1001037vm-test-run-nixbot-gitlab> gitlab # [   10.364967] postgresql-pre-start[1267]: selecting default "shared_buffers" ... 128MB1038vm-test-run-nixbot-gitlab> gitlab # [   10.436974] dhcpcd[1232]: eth0: soliciting a DHCP lease1039vm-test-run-nixbot-gitlab> gitlab # [   10.472639] dhcpcd[1232]: eth0: offered 10.0.2.15 from 10.0.2.21040vm-test-run-nixbot-gitlab> gitlab # [   10.488339] dhcpcd[1232]: eth0: probing address 10.0.2.15/241041vm-test-run-nixbot-gitlab> gitlab # [   10.676148] systemd[1]: Started gitlab-workhorse.service.1042vm-test-run-nixbot-gitlab> gitlab # [   10.807442] postgresql-pre-start[1267]: selecting default time zone ... UTC1043vm-test-run-nixbot-gitlab> gitlab # [   10.810547] postgresql-pre-start[1267]: creating configuration files ... ok1044vm-test-run-nixbot-gitlab> gitlab # [   11.048719] postgresql-pre-start[1267]: running bootstrap script ... ok1045vm-test-run-nixbot-gitlab> gitlab # [   11.117720] gitlab-workhorse[1291]: time="2026-06-29T22:05:57Z" level=info msg=Starting build_time=19700101.000000 version=18.11.41046vm-test-run-nixbot-gitlab> gitlab # [   11.120006] gitlab-workhorse[1291]: time="2026-06-29T22:05:57Z" level=info msg="Using redis/go-redis"1047vm-test-run-nixbot-gitlab> gitlab # [   11.122405] gitlab-workhorse[1291]: time="2026-06-29T22:05:57Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix1048vm-test-run-nixbot-gitlab> gitlab # [   11.467209] dhcpcd[1232]: eth0: soliciting an IPv6 router1049vm-test-run-nixbot-gitlab> gitlab # [   11.470158] dhcpcd[1232]: eth0: Router Advertisement from fe80::21050vm-test-run-nixbot-gitlab> gitlab # [   11.473019] dhcpcd[1232]: eth0: adding address fec0::5054:ff:fe12:3456/641051vm-test-run-nixbot-gitlab> gitlab # [   11.475988] dhcpcd[1232]: eth0: adding route to fec0::/641052vm-test-run-nixbot-gitlab> gitlab # [   11.478448] dhcpcd[1232]: eth0: adding default route via fe80::21053vm-test-run-nixbot-gitlab> gitlab # [   11.689662] postgresql-pre-start[1267]: performing post-bootstrap initialization ... ok1054vm-test-run-nixbot-gitlab> gitlab # [   11.977210] postgresql-pre-start[1267]: syncing data to disk ... ok1055vm-test-run-nixbot-gitlab> gitlab # [   11.980237] postgresql-pre-start[1267]: initdb: warning: enabling "trust" authentication for local connections1056vm-test-run-nixbot-gitlab> gitlab # [   11.984418] postgresql-pre-start[1267]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.1057vm-test-run-nixbot-gitlab> gitlab # [   11.990988] postgresql-pre-start[1267]: Success. You can now start the database server using:1058vm-test-run-nixbot-gitlab> gitlab # [   11.994853] postgresql-pre-start[1267]:     pg_ctl -D /var/lib/postgresql/17 -l logfile start1059vm-test-run-nixbot-gitlab> gitlab # [   12.153184] postgres[1325]: [1325] LOG:  starting PostgreSQL 17.10 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit1060vm-test-run-nixbot-gitlab> gitlab # [   12.159141] postgres[1325]: [1325] LOG:  listening on IPv6 address "::1", port 54321061vm-test-run-nixbot-gitlab> gitlab # [   12.162705] postgres[1325]: [1325] LOG:  listening on IPv4 address "127.0.0.1", port 54321062vm-test-run-nixbot-gitlab> gitlab # [   12.166500] postgres[1325]: [1325] LOG:  listening on Unix socket "/run/postgresql/.s.PGSQL.5432"1063vm-test-run-nixbot-gitlab> gitlab # [   12.171335] postgres[1331]: [1331] LOG:  database system was shut down at 2026-06-29 22:05:58 GMT1064vm-test-run-nixbot-gitlab> gitlab # [   12.178249] postgres[1325]: [1325] LOG:  database system is ready to accept connections1065vm-test-run-nixbot-gitlab> gitlab # [   12.183877] systemd[1]: Started PostgreSQL Server.1066vm-test-run-nixbot-gitlab> gitlab # [   12.192414] systemd[1]: Starting PostgreSQL Setup Scripts...1067vm-test-run-nixbot-gitlab> gitlab # [   12.412935] c0sj6d459nhf3wg9pm6ziy71l4581qq8-gitlab-config[1339]: mkdir -p /var/gitlab/state/home/.ssh: OK1068vm-test-run-nixbot-gitlab> gitlab # [   12.417166] c0sj6d459nhf3wg9pm6ziy71l4581qq8-gitlab-config[1339]: chmod 700 /var/gitlab/state/home/.ssh: OK1069vm-test-run-nixbot-gitlab> gitlab # [   12.459950] postgresql-setup-start[1347]: CREATE DATABASE1070vm-test-run-nixbot-gitlab> gitlab # [   12.506787] postgresql-setup-start[1361]: CREATE ROLE1071vm-test-run-nixbot-gitlab> gitlab # [   12.512933] systemd[1]: Finished gitlab-config.service.1072vm-test-run-nixbot-gitlab> gitlab # [   12.517834] systemd[1]: Started gitaly.service.1073vm-test-run-nixbot-gitlab> gitlab # [   12.530681] postgresql-setup-start[1365]: ALTER DATABASE1074vm-test-run-nixbot-gitlab> gitlab # [   12.581730] postgresql-setup-start[1373]: CREATE ROLE1075vm-test-run-nixbot-gitlab> gitlab # [   12.585053] systemd[1]: Finished PostgreSQL Setup Scripts.1076vm-test-run-nixbot-gitlab> gitlab # [   12.588603] systemd[1]: Reached target PostgreSQL.1077vm-test-run-nixbot-gitlab> gitlab # [   12.600149] systemd[1]: Starting gitlab-db-config.service...1078vm-test-run-nixbot-gitlab> gitlab # [   12.601911] systemd[1]: Starting gitlab-postgresql.service...1079vm-test-run-nixbot-gitlab> gitlab # [   12.802258] gitlab-postgresql-start[1383]: CREATE DATABASE1080vm-test-run-nixbot-gitlab> gitlab # [   12.876857] gitlab-postgresql-start[1393]: CREATE EXTENSION1081vm-test-run-nixbot-gitlab> gitlab # [   12.960264] gitlab-postgresql-start[1396]: CREATE EXTENSION1082vm-test-run-nixbot-gitlab> gitlab # [   12.962362] systemd[1]: Finished gitlab-postgresql.service.1083vm-test-run-nixbot-gitlab> gitlab # [   13.227819] gitaly[1367]: time="2026-06-29T22:06:00.094Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/krygc3bmd623znp2pddh3fv21q5f3nz2-gitaly.toml' and fix the errors that are printed." pid=13671084vm-test-run-nixbot-gitlab> gitlab # [   13.240246] gitaly[1367]: time="2026-06-29T22:06:00.095Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=13671085vm-test-run-nixbot-gitlab> gitlab # [   13.241895] gitaly[1367]: time="2026-06-29T22:06:00.095Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=13671086vm-test-run-nixbot-gitlab> gitlab # [   13.243945] gitaly[1367]: time="2026-06-29T22:06:00.095Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=13671087vm-test-run-nixbot-gitlab> gitlab # [   13.245847] gitaly[1367]: time="2026-06-29T22:06:00.096Z" level=info msg="Starting Gitaly" pid=1367 version=18.11.41088vm-test-run-nixbot-gitlab> gitlab # [   13.484496] gitaly[1367]: time="2026-06-29T22:06:00.351Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=254 pid=13671089vm-test-run-nixbot-gitlab> gitlab # [   13.486850] gitaly[1367]: time="2026-06-29T22:06:00.352Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=13671090vm-test-run-nixbot-gitlab> gitlab # [   13.488976] gitaly[1367]: time="2026-06-29T22:06:00.352Z" level=info msg="finished initializing command factory" duration_ms=0 pid=13671091vm-test-run-nixbot-gitlab> gitlab # [   13.490902] gitaly[1367]: time="2026-06-29T22:06:00.352Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-1367/git-exec-2954177521.d/git pid=13671092vm-test-run-nixbot-gitlab> gitlab # [   13.492983] gitaly[1367]: time="2026-06-29T22:06:00.359Z" level=info msg="finished detecting git version" duration_ms=7 pid=13671093vm-test-run-nixbot-gitlab> gitlab # [   13.495073] gitaly[1367]: time="2026-06-29T22:06:00.359Z" level=info msg="using Git version" pid=1367 version=2.53.g1094vm-test-run-nixbot-gitlab> gitlab # [   13.497108] gitaly[1367]: time="2026-06-29T22:06:00.360Z" level=info msg="clearing disk cache object folder" pid=1367 storage=default1095vm-test-run-nixbot-gitlab> gitlab # [   13.499326] gitaly[1367]: time="2026-06-29T22:06:00.360Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1845022961 pid=1367 storage=default1096vm-test-run-nixbot-gitlab> gitlab # [   13.504266] gitaly[1367]: time="2026-06-29T22:06:00.360Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1845022961 pid=1367 storage=default1097vm-test-run-nixbot-gitlab> gitlab # [   13.508075] gitaly[1367]: time="2026-06-29T22:06:00.360Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=13671098vm-test-run-nixbot-gitlab> gitlab # [   13.511445] gitaly[1367]: time="2026-06-29T22:06:00.360Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=13671099vm-test-run-nixbot-gitlab> gitlab # [   13.514676] gitaly[1367]: time="2026-06-29T22:06:00.360Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache1845022961 clear_duration_ms=0 pid=1367 storage=default1100vm-test-run-nixbot-gitlab> gitlab # [   13.518382] gitaly[1367]: time="2026-06-29T22:06:00.378Z" level=info msg="counting repositories" pid=13671101vm-test-run-nixbot-gitlab> gitlab # [   13.520101] gitaly[1367]: time="2026-06-29T22:06:00.378Z" level=info msg="starting to count repositories" pid=1367 storage_path=/var/gitlab/state/repositories1102vm-test-run-nixbot-gitlab> gitlab # [   13.522546] gitaly[1367]: time="2026-06-29T22:06:00.378Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=13671103vm-test-run-nixbot-gitlab> gitlab # [   13.525154] gitaly[1367]: time="2026-06-29T22:06:00.379Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=1367 schema=unix1104vm-test-run-nixbot-gitlab> gitlab # [   13.527725] gitaly[1367]: time="2026-06-29T22:06:00.379Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=1367 storage_path=/var/gitlab/state/repositories1105vm-test-run-nixbot-gitlab> gitlab # [   13.530736] gitaly[1367]: time="2026-06-29T22:06:00.379Z" level=info msg="completed counting all repositories" counting_duration=0 pid=13671106vm-test-run-nixbot-gitlab> gitlab # [   13.533137] gitaly[1367]: time="2026-06-29T22:06:00.379Z" level=info msg="listening at address" address=/run/gitaly/gitaly-1367/sock.d/intern pid=1367 schema=unix1107vm-test-run-nixbot-gitlab> gitlab # [   13.535738] gitaly[1367]: time="2026-06-29T22:06:00.379Z" level=info msg="finished tempdir cleaner walk" pid=1367 storage=default time_ms=01108vm-test-run-nixbot-gitlab> gitlab # [   13.538239] gitaly[1367]: time="2026-06-29T22:06:00.381Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=13671109vm-test-run-nixbot-gitlab> gitlab # [   13.540657] gitaly[1367]: time="2026-06-29T22:06:00.381Z" level=info msg="Started Gitaly" duration_ms=285 pid=13671110vm-test-run-nixbot-gitlab> gitlab # [   13.542748] gitaly[1367]: time="2026-06-29T22:06:00.381Z" level=info msg="maintenance: daily scheduled" pid=1367 scheduled="2026-06-30 12:00:00 +0000 UTC"1111vm-test-run-nixbot-gitlab> gitlab # [   13.864776] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1378]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1112vm-test-run-nixbot-gitlab> gitlab # [   13.873848] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1378]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1113vm-test-run-nixbot-gitlab> gitlab # [   13.887272] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1378]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1114vm-test-run-nixbot-gitlab> gitlab # [   15.573287] dhcpcd[1232]: eth0: leased 10.0.2.15 for 86400 seconds1115vm-test-run-nixbot-gitlab> gitlab # [   15.576269] dhcpcd[1232]: eth0: adding route to 10.0.2.0/241116vm-test-run-nixbot-gitlab> gitlab # [   15.578666] dhcpcd[1232]: eth0: adding default route via 10.0.2.21117vm-test-run-nixbot-gitlab> gitlab # [   15.705684] systemd[1]: Started DHCP Client.1118vm-test-run-nixbot-gitlab> gitlab # [   15.709553] systemd[1]: Reached target Network is Online.1119vm-test-run-nixbot-gitlab> gitlab # [   16.844241] gitaly[1367]: time="2026-06-29T22:06:03.710Z" level=info msg="License database preloaded" duration_ms=3614 pid=13671120vm-test-run-nixbot-gitlab> gitlab # [   56.715944] postgres[1849]: [1849] ERROR:  relation "feature_gates" does not exist at character 5231121vm-test-run-nixbot-gitlab> gitlab # [   56.716723] postgres[1849]: [1849] STATEMENT:  SELECT a.attname, format_type(a.atttypid, a.atttypmod),1122vm-test-run-nixbot-gitlab> gitlab # [   56.716856] postgres[1849]: 	       pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1123vm-test-run-nixbot-gitlab> gitlab # [   56.716983] postgres[1849]: 	       c.collname, col_description(a.attrelid, a.attnum) AS comment,1124vm-test-run-nixbot-gitlab> gitlab # [   56.717100] postgres[1849]: 	       attidentity AS identity,1125vm-test-run-nixbot-gitlab> gitlab # [   56.717237] postgres[1849]: 	       attgenerated as attgenerated1126vm-test-run-nixbot-gitlab> gitlab # [   56.717364] postgres[1849]: 	  FROM pg_attribute a1127vm-test-run-nixbot-gitlab> gitlab # [   56.717481] postgres[1849]: 	  LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1128vm-test-run-nixbot-gitlab> gitlab # [   56.717585] postgres[1849]: 	  LEFT JOIN pg_type t ON a.atttypid = t.oid1129vm-test-run-nixbot-gitlab> gitlab # [   56.717708] postgres[1849]: 	  LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1130vm-test-run-nixbot-gitlab> gitlab # [   56.717825] postgres[1849]: 	 WHERE a.attrelid = '"feature_gates"'::regclass1131vm-test-run-nixbot-gitlab> gitlab # [   56.717977] postgres[1849]: 	   AND a.attnum > 0 AND NOT a.attisdropped1132vm-test-run-nixbot-gitlab> gitlab # [   56.718098] postgres[1849]: 	 ORDER BY a.attnum1133vm-test-run-nixbot-gitlab> gitlab # [   56.718230] postgres[1849]:1134vm-test-run-nixbot-gitlab> gitlab # [   56.981910] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1378]: W, [2026-06-29T22:06:43.848346 #1378]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1135vm-test-run-nixbot-gitlab> gitlab # [   61.187299] gitlab-workhorse[1291]: time="2026-06-29T22:06:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1136vm-test-run-nixbot-gitlab> gitlab # [   65.004420] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1922]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE:  extension "btree_gist" already exists, skipping1137vm-test-run-nixbot-gitlab> gitlab # [   65.004830] 9831d0wkmwrjcjk9y25pj7qfsr5zj2vi-gitlab-db-config[1922]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE:  extension "pg_trgm" already exists, skipping1138vm-test-run-nixbot-gitlab> gitlab # [   71.188745] gitlab-workhorse[1291]: time="2026-06-29T22:06:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1139vm-test-run-nixbot-gitlab> gitlab # [   81.198690] gitlab-workhorse[1291]: time="2026-06-29T22:07:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1140vm-test-run-nixbot-gitlab> gitlab # [   88.885104] postgres[2016]: [2016] ERROR:  relation "table_without_models" does not exist1141vm-test-run-nixbot-gitlab> gitlab # [   88.885789] postgres[2016]: [2016] STATEMENT:  SELECT pg_get_serial_sequence('table_without_models', 'id')1142vm-test-run-nixbot-gitlab> gitlab # [   91.206100] gitlab-workhorse[1291]: time="2026-06-29T22:07:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1143vm-test-run-nixbot-gitlab> gitlab # [  101.214429] gitlab-workhorse[1291]: time="2026-06-29T22:07:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1144vm-test-run-nixbot-gitlab> gitlab # [  111.225414] gitlab-workhorse[1291]: time="2026-06-29T22:07:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1145vm-test-run-nixbot-gitlab> gitlab # [  120.400958] systemd[1]: Finished gitlab-db-config.service.1146vm-test-run-nixbot-gitlab> gitlab # [  120.406651] systemd[1]: Started gitlab-sidekiq.service.1147vm-test-run-nixbot-gitlab> gitlab # [  120.414252] systemd[1]: Starting gitlab.service...1148vm-test-run-nixbot-gitlab> gitlab # [  120.940840] bundle[2400]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1149vm-test-run-nixbot-gitlab> gitlab # [  120.947267] bundle[2400]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1150vm-test-run-nixbot-gitlab> gitlab # [  120.953376] bundle[2400]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1151vm-test-run-nixbot-gitlab> gitlab # [  121.234241] gitlab-workhorse[1291]: time="2026-06-29T22:07:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1152vm-test-run-nixbot-gitlab> gitlab # [  125.584567] sidekiq-cluster[2399]: {"severity":"INFO","time":"2026-06-29T22:07:52.424Z","message":"Starting cluster with 1 processes"}1153vm-test-run-nixbot-gitlab> gitlab # [  125.666492] bundle[2400]: {"timestamp":"2026-06-29T22:07:52.503Z","pid":2400,"message":"* Enabling systemd notification integration"}1154vm-test-run-nixbot-gitlab> gitlab # [  125.671640] bundle[2400]: {"timestamp":"2026-06-29T22:07:52.533Z","pid":2400,"message":"Puma starting in cluster mode..."}1155vm-test-run-nixbot-gitlab> gitlab # [  125.676210] bundle[2400]: {"timestamp":"2026-06-29T22:07:52.533Z","pid":2400,"message":"* Puma version: 7.2.0 (\"On The Corner\")"}1156vm-test-run-nixbot-gitlab> gitlab # [  125.680915] bundle[2400]: {"timestamp":"2026-06-29T22:07:52.533Z","pid":2400,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1157vm-test-run-nixbot-gitlab> gitlab # [  125.686895] bundle[2400]: {"timestamp":"2026-06-29T22:07:52.533Z","pid":2400,"message":"*  Min threads: 0"}1158vm-test-run-nixbot-gitlab> gitlab # [  125.690982] bundle[2400]: {"timestamp":"2026-06-29T22:07:52.533Z","pid":2400,"message":"*  Max threads: 4"}1159vm-test-run-nixbot-gitlab> gitlab # [  125.695093] bundle[2400]: {"timestamp":"2026-06-29T22:07:52.533Z","pid":2400,"message":"*  Environment: production"}1160vm-test-run-nixbot-gitlab> gitlab # [  125.699466] bundle[2400]: {"timestamp":"2026-06-29T22:07:52.533Z","pid":2400,"message":"*   Master PID: 2400"}1161vm-test-run-nixbot-gitlab> gitlab # [  125.703625] bundle[2400]: {"timestamp":"2026-06-29T22:07:52.533Z","pid":2400,"message":"*      Workers: 2"}1162vm-test-run-nixbot-gitlab> gitlab # [  125.708212] bundle[2400]: {"timestamp":"2026-06-29T22:07:52.533Z","pid":2400,"message":"*     Restarts: (✔) hot (✖) phased (✖) refork"}1163vm-test-run-nixbot-gitlab> gitlab # [  125.713698] bundle[2400]: {"timestamp":"2026-06-29T22:07:52.533Z","pid":2400,"message":"* Preloading application"}1164vm-test-run-nixbot-gitlab> gitlab # [  131.239771] gitlab-workhorse[1291]: time="2026-06-29T22:07:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1165vm-test-run-nixbot-gitlab> gitlab # [  141.242102] gitlab-workhorse[1291]: time="2026-06-29T22:08:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1166vm-test-run-nixbot-gitlab> gitlab # [  151.253991] gitlab-workhorse[1291]: time="2026-06-29T22:08:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1167vm-test-run-nixbot-gitlab> gitlab # [  161.256557] gitlab-workhorse[1291]: time="2026-06-29T22:08:28Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1168vm-test-run-nixbot-gitlab> gitlab # [  164.176528] bundle[2400]: W, [2026-06-29T22:08:31.043212 #2400]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1169vm-test-run-nixbot-gitlab> gitlab # [  167.619407] sidekiq-cluster[2440]: 2026-06-29T22:08:34.485Z pid=2440 tid=tmo INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2440, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>451837952}1170vm-test-run-nixbot-gitlab> gitlab # [  167.921750] sidekiq-cluster[2440]: W, [2026-06-29T22:08:34.789118 #2440]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1171vm-test-run-nixbot-gitlab> gitlab # [  167.982308] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:34.849Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1172vm-test-run-nixbot-gitlab> gitlab # [  171.262223] gitlab-workhorse[1291]: time="2026-06-29T22:08:38Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1173vm-test-run-nixbot-gitlab> gitlab # [  171.844328] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.710Z","message":"GitLab reliable fetch activated!"}1174vm-test-run-nixbot-gitlab> gitlab # [  171.844620] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.710Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1175vm-test-run-nixbot-gitlab> gitlab # [  171.877859] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.745Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1176vm-test-run-nixbot-gitlab> gitlab # [  171.885112] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.748Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1177vm-test-run-nixbot-gitlab> gitlab # [  171.891885] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.751Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1178vm-test-run-nixbot-gitlab> gitlab # [  171.899700] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.755Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1179vm-test-run-nixbot-gitlab> gitlab # [  171.906732] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.758Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1180vm-test-run-nixbot-gitlab> gitlab # [  171.913832] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.760Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1181vm-test-run-nixbot-gitlab> gitlab # [  171.920650] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.762Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1182vm-test-run-nixbot-gitlab> gitlab # [  171.926424] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.764Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1183vm-test-run-nixbot-gitlab> gitlab # [  171.932441] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.766Z","message":"Cron Jobs - added job with name expire_build_artifacts_worker in the namespace default"}1184vm-test-run-nixbot-gitlab> gitlab # [  171.938439] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.768Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1185vm-test-run-nixbot-gitlab> gitlab # [  171.944344] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.770Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1186vm-test-run-nixbot-gitlab> gitlab # [  171.949677] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.773Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1187vm-test-run-nixbot-gitlab> gitlab # [  171.954238] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.775Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1188vm-test-run-nixbot-gitlab> gitlab # [  171.958854] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.777Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1189vm-test-run-nixbot-gitlab> gitlab # [  171.963121] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.779Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1190vm-test-run-nixbot-gitlab> gitlab # [  171.967202] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.781Z","message":"Cron Jobs - added job with name environments_auto_delete_cron_worker in the namespace default"}1191vm-test-run-nixbot-gitlab> gitlab # [  171.971084] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.784Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1192vm-test-run-nixbot-gitlab> gitlab # [  171.974548] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.787Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1193vm-test-run-nixbot-gitlab> gitlab # [  171.977758] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.789Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1194vm-test-run-nixbot-gitlab> gitlab # [  171.981106] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.792Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1195vm-test-run-nixbot-gitlab> gitlab # [  171.984085] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.795Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1196vm-test-run-nixbot-gitlab> gitlab # [  171.987328] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.798Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1197vm-test-run-nixbot-gitlab> gitlab # [  171.990737] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.800Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1198vm-test-run-nixbot-gitlab> gitlab # [  171.993641] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.802Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1199vm-test-run-nixbot-gitlab> gitlab # [  171.996458] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.804Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1200vm-test-run-nixbot-gitlab> gitlab # [  171.999215] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.807Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1201vm-test-run-nixbot-gitlab> gitlab # [  172.001918] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.810Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1202vm-test-run-nixbot-gitlab> gitlab # [  172.004404] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.812Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1203vm-test-run-nixbot-gitlab> gitlab # [  172.006851] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.815Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1204vm-test-run-nixbot-gitlab> gitlab # [  172.009414] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.818Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1205vm-test-run-nixbot-gitlab> gitlab # [  172.011855] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.821Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1206vm-test-run-nixbot-gitlab> gitlab # [  172.014248] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.823Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1207vm-test-run-nixbot-gitlab> gitlab # [  172.016746] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.826Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1208vm-test-run-nixbot-gitlab> gitlab # [  172.018974] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.829Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1209vm-test-run-nixbot-gitlab> gitlab # [  172.021432] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.831Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1210vm-test-run-nixbot-gitlab> gitlab # [  172.023684] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.834Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1211vm-test-run-nixbot-gitlab> gitlab # [  172.026045] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.836Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1212vm-test-run-nixbot-gitlab> gitlab # [  172.028274] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.839Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1213vm-test-run-nixbot-gitlab> gitlab # [  172.030327] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.841Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1214vm-test-run-nixbot-gitlab> gitlab # [  172.032403] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.843Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1215vm-test-run-nixbot-gitlab> gitlab # [  172.034420] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.846Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1216vm-test-run-nixbot-gitlab> gitlab # [  172.036617] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.848Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1217vm-test-run-nixbot-gitlab> gitlab # [  172.038733] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.850Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1218vm-test-run-nixbot-gitlab> gitlab # [  172.041013] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.852Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1219vm-test-run-nixbot-gitlab> gitlab # [  172.043117] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.855Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1220vm-test-run-nixbot-gitlab> gitlab # [  172.045460] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.858Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1221vm-test-run-nixbot-gitlab> gitlab # [  172.047773] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.861Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1222vm-test-run-nixbot-gitlab> gitlab # [  172.050099] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.863Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1223vm-test-run-nixbot-gitlab> gitlab # [  172.052300] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.865Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1224vm-test-run-nixbot-gitlab> gitlab # [  172.054437] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.906Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1225vm-test-run-nixbot-gitlab> gitlab # [  172.056656] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.910Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1226vm-test-run-nixbot-gitlab> gitlab # [  172.058824] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.913Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1227vm-test-run-nixbot-gitlab> gitlab # [  172.061028] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.916Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1228vm-test-run-nixbot-gitlab> gitlab # [  172.064736] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.932Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1229vm-test-run-nixbot-gitlab> gitlab # [  172.069082] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.936Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1230vm-test-run-nixbot-gitlab> gitlab # [  172.072636] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.939Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1231vm-test-run-nixbot-gitlab> gitlab # [  172.076088] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.943Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1232vm-test-run-nixbot-gitlab> gitlab # [  172.079403] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.946Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1233vm-test-run-nixbot-gitlab> gitlab # [  172.083026] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.949Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1234vm-test-run-nixbot-gitlab> gitlab # [  172.086487] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.952Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1235vm-test-run-nixbot-gitlab> gitlab # [  172.089935] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.954Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1236vm-test-run-nixbot-gitlab> gitlab # [  172.093094] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.957Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1237vm-test-run-nixbot-gitlab> gitlab # [  172.096121] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.959Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1238vm-test-run-nixbot-gitlab> gitlab # [  172.099151] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.962Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1239vm-test-run-nixbot-gitlab> gitlab # [  172.102273] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.965Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1240vm-test-run-nixbot-gitlab> gitlab # [  172.105367] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.968Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1241vm-test-run-nixbot-gitlab> gitlab # [  172.108211] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.971Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1242vm-test-run-nixbot-gitlab> gitlab # [  172.110835] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.974Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1243vm-test-run-nixbot-gitlab> gitlab # [  172.113654] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.975Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1244vm-test-run-nixbot-gitlab> gitlab # [  172.117482] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.977Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1245vm-test-run-nixbot-gitlab> gitlab # [  172.120168] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.980Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1246vm-test-run-nixbot-gitlab> gitlab # [  172.122815] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.981Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1247vm-test-run-nixbot-gitlab> gitlab # [  172.125574] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.984Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1248vm-test-run-nixbot-gitlab> gitlab # [  172.128242] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.986Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1249vm-test-run-nixbot-gitlab> gitlab # [  172.131038] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.988Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1250vm-test-run-nixbot-gitlab> gitlab # [  172.133891] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.990Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1251vm-test-run-nixbot-gitlab> gitlab # [  172.136652] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.992Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1252vm-test-run-nixbot-gitlab> gitlab # [  172.139227] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.995Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1253vm-test-run-nixbot-gitlab> gitlab # [  172.142261] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:38.997Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1254vm-test-run-nixbot-gitlab> gitlab # [  172.144828] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.000Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1255vm-test-run-nixbot-gitlab> gitlab # [  172.147294] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.002Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1256vm-test-run-nixbot-gitlab> gitlab # [  172.150103] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.005Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1257vm-test-run-nixbot-gitlab> gitlab # [  172.152849] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.007Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1258vm-test-run-nixbot-gitlab> gitlab # [  172.155335] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.010Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1259vm-test-run-nixbot-gitlab> gitlab # [  172.157823] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.012Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1260vm-test-run-nixbot-gitlab> gitlab # [  172.160316] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.015Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1261vm-test-run-nixbot-gitlab> gitlab # [  172.162594] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.017Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1262vm-test-run-nixbot-gitlab> gitlab # [  172.165031] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.020Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1263vm-test-run-nixbot-gitlab> gitlab # [  172.167306] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.022Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1264vm-test-run-nixbot-gitlab> gitlab # [  172.169776] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.024Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1265vm-test-run-nixbot-gitlab> gitlab # [  172.172111] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.027Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1266vm-test-run-nixbot-gitlab> gitlab # [  172.174460] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.029Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1267vm-test-run-nixbot-gitlab> gitlab # [  172.176811] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.031Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1268vm-test-run-nixbot-gitlab> gitlab # [  172.179153] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.033Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1269vm-test-run-nixbot-gitlab> gitlab # [  172.181722] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.035Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1270vm-test-run-nixbot-gitlab> gitlab # [  172.183700] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.039Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1271vm-test-run-nixbot-gitlab> gitlab # [  172.186209] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.042Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1272vm-test-run-nixbot-gitlab> gitlab # [  172.188524] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.044Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1273vm-test-run-nixbot-gitlab> gitlab # [  172.190771] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.046Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1274vm-test-run-nixbot-gitlab> gitlab # [  172.193128] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.060Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1275vm-test-run-nixbot-gitlab> gitlab # [  172.195398] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.062Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1276vm-test-run-nixbot-gitlab> gitlab # [  172.197786] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.064Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1277vm-test-run-nixbot-gitlab> gitlab # [  172.200825] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.068Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1278vm-test-run-nixbot-gitlab> gitlab # [  172.203655] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.071Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1279vm-test-run-nixbot-gitlab> gitlab # [  172.206830] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.074Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1280vm-test-run-nixbot-gitlab> gitlab # [  172.210051] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.077Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1281vm-test-run-nixbot-gitlab> gitlab # [  172.212487] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.079Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1282vm-test-run-nixbot-gitlab> gitlab # [  172.214615] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.081Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1283vm-test-run-nixbot-gitlab> gitlab # [  172.217762] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.085Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1284vm-test-run-nixbot-gitlab> gitlab # [  172.219995] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:08:39.087Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1285vm-test-run-nixbot-gitlab> gitlab # [  181.270230] gitlab-workhorse[1291]: time="2026-06-29T22:08:48Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1286vm-test-run-nixbot-gitlab> gitlab # [  191.278428] gitlab-workhorse[1291]: time="2026-06-29T22:08:58Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1287vm-test-run-nixbot-gitlab> gitlab # [  201.282785] gitlab-workhorse[1291]: time="2026-06-29T22:09:08Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1288vm-test-run-nixbot-gitlab> gitlab # [  210.326963] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:17.193Z","message":"Booted Rails 7.2.3 application in production environment"}1289vm-test-run-nixbot-gitlab> gitlab # [  210.329162] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:17.196Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1290vm-test-run-nixbot-gitlab> gitlab # [  210.331225] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:17.196Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1291vm-test-run-nixbot-gitlab> gitlab # [  210.333134] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:17.196Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1292vm-test-run-nixbot-gitlab> gitlab # [  210.335163] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:17.200Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1293vm-test-run-nixbot-gitlab> gitlab # [  211.290246] gitlab-workhorse[1291]: time="2026-06-29T22:09:18Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1294vm-test-run-nixbot-gitlab> gitlab # [  212.284684] bundle[2400]: {"timestamp":"2026-06-29T22:09:19.151Z","pid":2400,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1295vm-test-run-nixbot-gitlab> gitlab # [  212.285012] bundle[2400]: {"timestamp":"2026-06-29T22:09:19.151Z","pid":2400,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1296vm-test-run-nixbot-gitlab> gitlab # [  212.285206] bundle[2400]: {"timestamp":"2026-06-29T22:09:19.151Z","pid":2400,"message":"! #\u003cThread:0x0000fcaa63a52a48 /nix/store/09wikq0z4z0s8mkafl8f2b6yp0p78frd-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/09wikq0z4z0s8mkafl8f2b6yp0p78frd-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1297vm-test-run-nixbot-gitlab> gitlab # [  212.285336] bundle[2400]: {"timestamp":"2026-06-29T22:09:19.151Z","pid":2400,"message":"! #\u003cThread:0x0000fcaa63ca8720 /nix/store/q2bwpwxril8z19gq9b1nnv72drlwhhg8-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/q2bwpwxril8z19gq9b1nnv72drlwhhg8-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1298vm-test-run-nixbot-gitlab> gitlab # [  212.285455] bundle[2400]: {"timestamp":"2026-06-29T22:09:19.151Z","pid":2400,"message":"Use Ctrl-C to stop"}1299vm-test-run-nixbot-gitlab> gitlab # [  212.285572] bundle[2400]: {"timestamp":"2026-06-29T22:09:19.151Z","pid":2400,"message":"Sending status to systemd every 1.0 sec"}1300vm-test-run-nixbot-gitlab> gitlab # [  212.975174] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:19.841Z","message":"Cleaning working queues"}1301vm-test-run-nixbot-gitlab> gitlab # [  212.980087] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:19.846Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"68067fb853bc16d3ca4de90c","created_at":"2026-06-29T22:07:46.248Z","trace_propagation_headers":{"sentry-trace":"41fdcddb23024574ba53947f106b7c8c-7568be766120463f","baggage":"sentry-trace_id=41fdcddb23024574ba53947f106b7c8c,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"cd3f5eeccb30b1b552070f9442e9293d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-29T22:07:46.260Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-68067fb853bc16d3ca4de90c: start","job_status":"start","queue_duration_s":93.58647,"scheduling_latency_s":93.586525}1302vm-test-run-nixbot-gitlab> gitlab # [  213.145653] bundle[2400]: {"timestamp":"2026-06-29T22:09:20.011Z","pid":2400,"message":"- Worker 0 (PID: 3224) booted in 0.82s, phase: 0"}1303vm-test-run-nixbot-gitlab> gitlab # [  213.174774] bundle[2400]: {"timestamp":"2026-06-29T22:09:20.042Z","pid":2400,"message":"- Worker 1 (PID: 3228) booted in 0.83s, phase: 0"}1304vm-test-run-nixbot-gitlab> gitlab # [  213.178442] systemd[1]: Started gitlab.service.1305vm-test-run-nixbot-gitlab> gitlab # [  213.179275] systemd[1]: Reached target Common target for all GitLab services..1306vm-test-run-nixbot-gitlab> gitlab # [  213.182970] systemd[1]: Starting setup-gitlab.service...1307vm-test-run-nixbot-gitlab> gitlab # [  213.218406] setup-gitlab-start[3268]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1308vm-test-run-nixbot-gitlab> gitlab # [  213.222994] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:20.089Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"68067fb853bc16d3ca4de90c","created_at":"2026-06-29T22:07:46.248Z","trace_propagation_headers":{"sentry-trace":"41fdcddb23024574ba53947f106b7c8c-7568be766120463f","baggage":"sentry-trace_id=41fdcddb23024574ba53947f106b7c8c,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"cd3f5eeccb30b1b552070f9442e9293d","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-29T22:07:46.260Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-68067fb853bc16d3ca4de90c: done: 0.243329 sec","job_status":"done","queue_duration_s":93.58647,"scheduling_latency_s":93.586525,"redis_calls":24,"redis_duration_s":0.005992,"redis_read_bytes":912,"redis_write_bytes":2622,"redis_feature_flag_calls":13,"redis_feature_flag_duration_s":0.002706,"redis_feature_flag_read_bytes":902,"redis_feature_flag_write_bytes":1375,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001981,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001305,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.115884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.13131489999999998,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.243329,"completed_at":"2026-06-29T22:09:20.089Z","load_balancing_strategy":"primary","db_duration_s":0.076623,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1309vm-test-run-nixbot-gitlab> gitlab # [  216.568263] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:09:23 +0000] "GET /users/sign_in HTTP/1.1" 200 10624 "" "curl/8.20.0" 33091310vm-test-run-nixbot-gitlab> gitlab # [  216.574870] setup-gitlab-start[3291]: ++ curl -fs -X POST -H 'Content-Type: application/json' -d '{"grant_type":"password","username":"root","password":"notproduction"}' http://gitlab/oauth/token1311vm-test-run-nixbot-gitlab> gitlab # [  216.583248] setup-gitlab-start[3292]: ++ jq -r .access_token1312vm-test-run-nixbot-gitlab> gitlab # [  217.526259] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:09:24 +0000] "POST /oauth/token HTTP/1.1" 200 244 "" "curl/8.20.0" 9241313vm-test-run-nixbot-gitlab> gitlab # [  217.531598] setup-gitlab-start[3268]: + BEARER=dd66e1567f22139cf7a8adb3ebbf4353c5a9a744f6458880686fe8b67bfea1af1314vm-test-run-nixbot-gitlab> gitlab # [  217.539329] setup-gitlab-start[3268]: + AUTH='Authorization: Bearer dd66e1567f22139cf7a8adb3ebbf4353c5a9a744f6458880686fe8b67bfea1af'1315vm-test-run-nixbot-gitlab> gitlab # [  217.544351] setup-gitlab-start[3268]: + curl -fs -X PUT -H 'Authorization: Bearer dd66e1567f22139cf7a8adb3ebbf4353c5a9a744f6458880686fe8b67bfea1af' 'http://gitlab/api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true'1316vm-test-run-nixbot-gitlab> gitlab # [  218.481787] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:09:25 +0000] "PUT /api/v4/application/settings?allow_local_requests_from_web_hooks_and_services=true HTTP/1.1" 200 17133 "" "curl/8.20.0" 9371317vm-test-run-nixbot-gitlab> gitlab # [  218.487677] setup-gitlab-start[3268]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner Rails.cache.clear1318vm-test-run-nixbot-gitlab> gitlab # [  218.503328] runuser[3310]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1319vm-test-run-nixbot-gitlab> gitlab # [  219.012318] setup-gitlab-start[3311]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1320vm-test-run-nixbot-gitlab> gitlab # [  219.019037] setup-gitlab-start[3311]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1321vm-test-run-nixbot-gitlab> gitlab # [  219.025653] setup-gitlab-start[3311]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1322vm-test-run-nixbot-gitlab> gitlab # [  219.757988] setup-gitlab-start[3311]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1323vm-test-run-nixbot-gitlab> gitlab # [  219.758813] setup-gitlab-start[3311]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1324vm-test-run-nixbot-gitlab> gitlab # [  219.771112] setup-gitlab-start[3311]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1325vm-test-run-nixbot-gitlab> gitlab # [  223.118602] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:29.984Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"489993a08843af67942d6795","created_at":"2026-06-29T22:09:29.937Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37bfa347ba56dd7d9b43fb9febefeec7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:29.980Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-489993a08843af67942d6795: start","job_status":"start","queue_duration_s":0.003482,"scheduling_latency_s":0.003543}1326vm-test-run-nixbot-gitlab> gitlab # [  224.242795] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.108Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"489993a08843af67942d6795","created_at":"2026-06-29T22:09:29.937Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37bfa347ba56dd7d9b43fb9febefeec7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:29.980Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-489993a08843af67942d6795: done: 1.124331 sec","job_status":"done","queue_duration_s":0.003482,"scheduling_latency_s":0.003543,"redis_calls":14,"redis_duration_s":0.023105999999999998,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.010549,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00972,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002837,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":125,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":125,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.083,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":123,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":80,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.055,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.603438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00244326,"exclusive_lock_hold_duration_s":0.9228006599999999,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":1.124331,"completed_at":"2026-06-29T22:09:31.108Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.181831,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327vm-test-run-nixbot-gitlab> gitlab # [  224.243425] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9a702027eddfe237f00cd0c2","created_at":"2026-06-29T22:09:29.999Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d454cf2d613364ce9e69192eb9ea5037","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.031Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9a702027eddfe237f00cd0c2: start","job_status":"start","queue_duration_s":1.078659,"scheduling_latency_s":1.07868}1328vm-test-run-nixbot-gitlab> gitlab # [  224.346650] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.136Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"9a702027eddfe237f00cd0c2","created_at":"2026-06-29T22:09:29.999Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d454cf2d613364ce9e69192eb9ea5037","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.031Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-9a702027eddfe237f00cd0c2: done: 0.025893 sec","job_status":"done","queue_duration_s":1.078659,"scheduling_latency_s":1.07868,"redis_calls":12,"redis_duration_s":0.001719,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000295,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000786,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000638,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015263,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0004664,"exclusive_lock_hold_duration_s":0.00565842,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.025893,"completed_at":"2026-06-29T22:09:31.136Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003026,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329vm-test-run-nixbot-gitlab> gitlab # [  225.081144] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.137Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"782c46759abafdfdc316f86e","created_at":"2026-06-29T22:09:30.050Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"668cd4a233352db68915949ba76e76c2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.074Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-782c46759abafdfdc316f86e: start","job_status":"start","queue_duration_s":1.063383,"scheduling_latency_s":1.063402}1330vm-test-run-nixbot-gitlab> gitlab # [  225.116516] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.163Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"782c46759abafdfdc316f86e","created_at":"2026-06-29T22:09:30.050Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"668cd4a233352db68915949ba76e76c2","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.074Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-782c46759abafdfdc316f86e: done: 0.025306 sec","job_status":"done","queue_duration_s":1.063383,"scheduling_latency_s":1.063402,"redis_calls":10,"redis_duration_s":0.001357,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000275,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000792,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00029,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014439,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023768,"duration_s":0.025306,"completed_at":"2026-06-29T22:09:31.163Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331vm-test-run-nixbot-gitlab> gitlab # [  225.173454] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.165Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"1e5d9bdcb484386412389045","created_at":"2026-06-29T22:09:30.093Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2d286154124cb2752533f03801e0374","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-29T22:09:30.107Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-1e5d9bdcb484386412389045: start","job_status":"start","queue_duration_s":1.057665,"scheduling_latency_s":1.057684}1332vm-test-run-nixbot-gitlab> gitlab # [  225.187271] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.200Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"1e5d9bdcb484386412389045","created_at":"2026-06-29T22:09:30.093Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c2d286154124cb2752533f03801e0374","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-29T22:09:30.107Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-1e5d9bdcb484386412389045: done: 0.035433 sec","job_status":"done","queue_duration_s":1.057665,"scheduling_latency_s":1.057684,"redis_calls":10,"redis_duration_s":0.001417,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000285,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000826,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000306,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02126,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00026846,"duration_s":0.035433,"completed_at":"2026-06-29T22:09:31.200Z","load_balancing_strategy":"primary","db_duration_s":0.007541,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333vm-test-run-nixbot-gitlab> gitlab # [  225.230163] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.201Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1bf2db19e4bfcd3fab5aabab","created_at":"2026-06-29T22:09:30.160Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"131d179273ddbff239fe4317b22f4ed8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.173Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1bf2db19e4bfcd3fab5aabab: start","job_status":"start","queue_duration_s":1.027724,"scheduling_latency_s":1.027742}1334vm-test-run-nixbot-gitlab> gitlab # [  225.245655] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.213Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1335vm-test-run-nixbot-gitlab> gitlab # [  225.249548] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.221Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"1bf2db19e4bfcd3fab5aabab","created_at":"2026-06-29T22:09:30.160Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"131d179273ddbff239fe4317b22f4ed8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.173Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-1bf2db19e4bfcd3fab5aabab: done: 0.019893 sec","job_status":"done","queue_duration_s":1.027724,"scheduling_latency_s":1.027742,"redis_calls":10,"redis_duration_s":0.0018839999999999998,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000298,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001003,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000583,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00054618,"duration_s":0.019893,"completed_at":"2026-06-29T22:09:31.221Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000685,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1336vm-test-run-nixbot-gitlab> gitlab # [  225.292687] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.223Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c0e3451b604e68a84613be3a","created_at":"2026-06-29T22:09:30.251Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d11f0c73c2e5612de65f74cab5553605","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.266Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c0e3451b604e68a84613be3a: start","job_status":"start","queue_duration_s":0.956603,"scheduling_latency_s":0.95662}1337vm-test-run-nixbot-gitlab> gitlab # [  225.306341] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.252Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"c0e3451b604e68a84613be3a","created_at":"2026-06-29T22:09:30.251Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d11f0c73c2e5612de65f74cab5553605","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.266Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-c0e3451b604e68a84613be3a: done: 0.029616 sec","job_status":"done","queue_duration_s":0.956603,"scheduling_latency_s":0.95662,"redis_calls":12,"redis_duration_s":0.0030369999999999998,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000471,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001431,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001135,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015677,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005737,"exclusive_lock_hold_duration_s":0.008700560000000001,"duration_s":0.029616,"completed_at":"2026-06-29T22:09:31.252Z","load_balancing_strategy":"primary","db_duration_s":0.005372,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1338vm-test-run-nixbot-gitlab> gitlab # [  225.348370] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.254Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e7249d752114a21156b28931","created_at":"2026-06-29T22:09:30.280Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27535151463c66ad2c3976c3e37acb66","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.293Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e7249d752114a21156b28931: start","job_status":"start","queue_duration_s":0.961025,"scheduling_latency_s":0.961043}1339vm-test-run-nixbot-gitlab> gitlab # [  225.362833] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.301Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"e7249d752114a21156b28931","created_at":"2026-06-29T22:09:30.280Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"27535151463c66ad2c3976c3e37acb66","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.293Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-e7249d752114a21156b28931: done: 0.04731 sec","job_status":"done","queue_duration_s":0.961025,"scheduling_latency_s":0.961043,"redis_calls":16,"redis_duration_s":0.003804,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.001931,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001369,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000504,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.015,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032538,"duration_s":0.04731,"completed_at":"2026-06-29T22:09:31.301Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.017757,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1340vm-test-run-nixbot-gitlab> gitlab # [  225.406186] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.303Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"36df1460f912bedbe46ebcf2","created_at":"2026-06-29T22:09:30.306Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.315Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-36df1460f912bedbe46ebcf2: start","job_status":"start","queue_duration_s":0.987647,"scheduling_latency_s":0.987663}1341vm-test-run-nixbot-gitlab> gitlab # [  225.421325] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.413Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"36df1460f912bedbe46ebcf2","created_at":"2026-06-29T22:09:30.306Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.315Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-36df1460f912bedbe46ebcf2: done: 0.110494 sec","job_status":"done","queue_duration_s":0.987647,"scheduling_latency_s":0.987663,"redis_calls":71,"redis_duration_s":0.01785,"redis_read_bytes":120,"redis_write_bytes":42624,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002344,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000825,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37435,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.013906,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000775,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.090758,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033312,"duration_s":0.110494,"completed_at":"2026-06-29T22:09:31.413Z","load_balancing_strategy":"primary","db_duration_s":0.002289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1342vm-test-run-nixbot-gitlab> gitlab # [  225.464887] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.420Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"dcc606614cb71bc599934eba","created_at":"2026-06-29T22:09:30.339Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2bda7ccf406bb6b997f9555dc4e694f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.349Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-dcc606614cb71bc599934eba: start","job_status":"start","queue_duration_s":1.070518,"scheduling_latency_s":1.070538}1343vm-test-run-nixbot-gitlab> gitlab # [  225.479681] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.433Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1344vm-test-run-nixbot-gitlab> gitlab # [  225.483532] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.441Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"dcc606614cb71bc599934eba","created_at":"2026-06-29T22:09:30.339Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f2bda7ccf406bb6b997f9555dc4e694f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.349Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-dcc606614cb71bc599934eba: done: 0.020859 sec","job_status":"done","queue_duration_s":1.070518,"scheduling_latency_s":1.070538,"redis_calls":10,"redis_duration_s":0.002548,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000468,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001535,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000545,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011553,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045642,"duration_s":0.020859,"completed_at":"2026-06-29T22:09:31.441Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000395,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345vm-test-run-nixbot-gitlab> gitlab # [  225.526830] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.442Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8de22687456374f1073e30ab","created_at":"2026-06-29T22:09:30.355Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a743239a1a36887552e58a3dfb0cfc2b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.370Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8de22687456374f1073e30ab: start","job_status":"start","queue_duration_s":1.072118,"scheduling_latency_s":1.072134}1346vm-test-run-nixbot-gitlab> gitlab # [  225.540669] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.481Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"8de22687456374f1073e30ab","created_at":"2026-06-29T22:09:30.355Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a743239a1a36887552e58a3dfb0cfc2b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.370Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-8de22687456374f1073e30ab: done: 0.038767 sec","job_status":"done","queue_duration_s":1.072118,"scheduling_latency_s":1.072134,"redis_calls":19,"redis_duration_s":0.0059310000000000005,"redis_read_bytes":22,"redis_write_bytes":4785,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00219,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000325,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.002524,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.024936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003364,"duration_s":0.038767,"completed_at":"2026-06-29T22:09:31.481Z","load_balancing_strategy":"primary","db_duration_s":0.003085,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347vm-test-run-nixbot-gitlab> gitlab # [  225.584141] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.483Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"07ea158f61a5b4c762a15cda","created_at":"2026-06-29T22:09:30.403Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c936a7ea6e46f04f438b1a186ac3c65d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.415Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-07ea158f61a5b4c762a15cda: start","job_status":"start","queue_duration_s":1.06794,"scheduling_latency_s":1.067958}1348vm-test-run-nixbot-gitlab> gitlab # [  225.599173] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.540Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"07ea158f61a5b4c762a15cda","created_at":"2026-06-29T22:09:30.403Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c936a7ea6e46f04f438b1a186ac3c65d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.415Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-07ea158f61a5b4c762a15cda: done: 0.056596 sec","job_status":"done","queue_duration_s":1.06794,"scheduling_latency_s":1.067958,"redis_calls":12,"redis_duration_s":0.004344,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000449,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002642,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001253,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00070378,"exclusive_lock_hold_duration_s":0.024133500000000002,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.056596,"completed_at":"2026-06-29T22:09:31.540Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.026769,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349vm-test-run-nixbot-gitlab> gitlab # [  225.646370] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.542Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"9d68dfd92f026c8dfd52dbd9","created_at":"2026-06-29T22:09:30.421Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"794224bd9039d34b99fdf86586ad8ab4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.427Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-9d68dfd92f026c8dfd52dbd9: start","job_status":"start","queue_duration_s":1.114678,"scheduling_latency_s":1.114696}1350vm-test-run-nixbot-gitlab> gitlab # [  225.661456] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.554Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1351vm-test-run-nixbot-gitlab> gitlab # [  225.664837] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.562Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"9d68dfd92f026c8dfd52dbd9","created_at":"2026-06-29T22:09:30.421Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"794224bd9039d34b99fdf86586ad8ab4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.427Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-9d68dfd92f026c8dfd52dbd9: done: 0.019963 sec","job_status":"done","queue_duration_s":1.114678,"scheduling_latency_s":1.114696,"redis_calls":10,"redis_duration_s":0.00263,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000483,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001461,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000686,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01114,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037592,"duration_s":0.019963,"completed_at":"2026-06-29T22:09:31.562Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0007,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1352vm-test-run-nixbot-gitlab> gitlab # [  225.708193] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.563Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"db5b6f0aabf1e329245efab4","created_at":"2026-06-29T22:09:30.431Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e65f859ff72eb553098e05d9c3236128","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.438Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-db5b6f0aabf1e329245efab4: start","job_status":"start","queue_duration_s":1.125341,"scheduling_latency_s":1.125357}1353vm-test-run-nixbot-gitlab> gitlab # [  225.722940] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.575Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1354vm-test-run-nixbot-gitlab> gitlab # [  225.726347] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.582Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"db5b6f0aabf1e329245efab4","created_at":"2026-06-29T22:09:30.431Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e65f859ff72eb553098e05d9c3236128","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.438Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-db5b6f0aabf1e329245efab4: done: 0.019133 sec","job_status":"done","queue_duration_s":1.125341,"scheduling_latency_s":1.125357,"redis_calls":10,"redis_duration_s":0.002284,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000476,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001333,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000475,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032222,"duration_s":0.019133,"completed_at":"2026-06-29T22:09:31.582Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000537,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355vm-test-run-nixbot-gitlab> gitlab # [  225.769611] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.584Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"460a993dbb173013283ec34d","created_at":"2026-06-29T22:09:30.451Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e922290e8e6e7bcfec1851023b64073","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.457Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-460a993dbb173013283ec34d: start","job_status":"start","queue_duration_s":1.127331,"scheduling_latency_s":1.127347}1356vm-test-run-nixbot-gitlab> gitlab # [  225.784286] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.606Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"460a993dbb173013283ec34d","created_at":"2026-06-29T22:09:30.451Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3e922290e8e6e7bcfec1851023b64073","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.457Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-460a993dbb173013283ec34d: done: 0.022096 sec","job_status":"done","queue_duration_s":1.127331,"scheduling_latency_s":1.127347,"redis_calls":12,"redis_duration_s":0.002795,"redis_read_bytes":11,"redis_write_bytes":1482,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00095,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":610,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001368,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000477,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003225,"duration_s":0.022096,"completed_at":"2026-06-29T22:09:31.606Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000932,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357vm-test-run-nixbot-gitlab> gitlab # [  225.828768] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.608Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"5cc54865ee57f09bd643ab8e","created_at":"2026-06-29T22:09:30.467Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6728834710e8650741f8b5926f957f3c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.476Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-5cc54865ee57f09bd643ab8e: start","job_status":"start","queue_duration_s":1.131459,"scheduling_latency_s":1.131485}1358vm-test-run-nixbot-gitlab> gitlab # [  225.843672] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.643Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"5cc54865ee57f09bd643ab8e","created_at":"2026-06-29T22:09:30.467Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6728834710e8650741f8b5926f957f3c","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.476Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-5cc54865ee57f09bd643ab8e: done: 0.034792 sec","job_status":"done","queue_duration_s":1.131459,"scheduling_latency_s":1.131485,"redis_calls":13,"redis_duration_s":0.003099,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000467,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001566,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001066,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021285,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01322196,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.034792,"completed_at":"2026-06-29T22:09:31.643Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005757,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1359vm-test-run-nixbot-gitlab> gitlab # [  225.888695] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.644Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"10672660fecfa6063f1e9691","created_at":"2026-06-29T22:09:30.490Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35305afcf7cbff1401cca298ff10781d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.495Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-10672660fecfa6063f1e9691: start","job_status":"start","queue_duration_s":1.148813,"scheduling_latency_s":1.148829}1360vm-test-run-nixbot-gitlab> gitlab # [  225.903677] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.664Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"10672660fecfa6063f1e9691","created_at":"2026-06-29T22:09:30.490Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"35305afcf7cbff1401cca298ff10781d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.495Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-10672660fecfa6063f1e9691: done: 0.02014 sec","job_status":"done","queue_duration_s":1.148813,"scheduling_latency_s":1.148829,"redis_calls":10,"redis_duration_s":0.002511,"redis_read_bytes":9,"redis_write_bytes":1299,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000476,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":361,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001534,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000501,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01162,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004316,"duration_s":0.02014,"completed_at":"2026-06-29T22:09:31.664Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000593,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361vm-test-run-nixbot-gitlab> gitlab # [  225.947418] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.666Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b10b8363d55951a3e9373a6e","created_at":"2026-06-29T22:09:30.503Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a23282448d676748a3415b78cb29842f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-29T22:09:30.508Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b10b8363d55951a3e9373a6e: start","job_status":"start","queue_duration_s":1.15739,"scheduling_latency_s":1.157405}1362vm-test-run-nixbot-gitlab> gitlab # [  225.961085] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.678Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1363vm-test-run-nixbot-gitlab> gitlab # [  225.964426] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.685Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"b10b8363d55951a3e9373a6e","created_at":"2026-06-29T22:09:30.503Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a23282448d676748a3415b78cb29842f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-29T22:09:30.508Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-b10b8363d55951a3e9373a6e: done: 0.019209 sec","job_status":"done","queue_duration_s":1.15739,"scheduling_latency_s":1.157405,"redis_calls":10,"redis_duration_s":0.002439,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000478,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001427,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000534,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032144,"duration_s":0.019209,"completed_at":"2026-06-29T22:09:31.685Z","load_balancing_strategy":"primary","db_duration_s":0.000543,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1364vm-test-run-nixbot-gitlab> gitlab # [  226.006038] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.686Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"eaf38652d95345e03b4e5746","created_at":"2026-06-29T22:09:30.516Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d381f55a9acd4d7cdc6e7b772663d9b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-29T22:09:30.522Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-eaf38652d95345e03b4e5746: start","job_status":"start","queue_duration_s":1.164742,"scheduling_latency_s":1.164758}1365vm-test-run-nixbot-gitlab> gitlab # [  226.019454] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.698Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1366vm-test-run-nixbot-gitlab> gitlab # [  226.024426] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.706Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"eaf38652d95345e03b4e5746","created_at":"2026-06-29T22:09:30.516Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d381f55a9acd4d7cdc6e7b772663d9b2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-29T22:09:30.522Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-eaf38652d95345e03b4e5746: done: 0.019817 sec","job_status":"done","queue_duration_s":1.164742,"scheduling_latency_s":1.164758,"redis_calls":10,"redis_duration_s":0.002357,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000443,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001435,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000479,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032762,"duration_s":0.019817,"completed_at":"2026-06-29T22:09:31.706Z","load_balancing_strategy":"primary","db_duration_s":0.000471,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367vm-test-run-nixbot-gitlab> gitlab # [  226.066118] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:31.708Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"eda702fccf3272b21412e902","created_at":"2026-06-29T22:09:30.526Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d1622506dd6f45b49798f564fea9d37","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.531Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-eda702fccf3272b21412e902: start","job_status":"start","queue_duration_s":1.176145,"scheduling_latency_s":1.17616}1368vm-test-run-nixbot-gitlab> gitlab # [  226.080437] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.081Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"eda702fccf3272b21412e902","created_at":"2026-06-29T22:09:30.526Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d1622506dd6f45b49798f564fea9d37","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.531Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-eda702fccf3272b21412e902: done: 0.373551 sec","job_status":"done","queue_duration_s":1.176145,"scheduling_latency_s":1.17616,"redis_calls":574,"redis_duration_s":0.142462,"redis_read_bytes":573,"redis_write_bytes":49866,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000501,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.140961,"redis_shared_state_read_bytes":567,"redis_shared_state_write_bytes":49017,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.264237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00023364,"duration_s":0.373551,"completed_at":"2026-06-29T22:09:32.081Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000472,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369vm-test-run-nixbot-gitlab> gitlab # [  226.122860] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.082Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e907447fd3dd01a75de60fe2","created_at":"2026-06-29T22:09:30.538Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56ef1f47032500d1bf9a5234c8ee7bd2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.544Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e907447fd3dd01a75de60fe2: start","job_status":"start","queue_duration_s":1.538216,"scheduling_latency_s":1.538233}1370vm-test-run-nixbot-gitlab> gitlab # [  226.137830] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.121Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"e907447fd3dd01a75de60fe2","created_at":"2026-06-29T22:09:30.538Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"56ef1f47032500d1bf9a5234c8ee7bd2","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.544Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-e907447fd3dd01a75de60fe2: done: 0.038383 sec","job_status":"done","queue_duration_s":1.538216,"scheduling_latency_s":1.538233,"redis_calls":12,"redis_duration_s":0.0021190000000000002,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000308,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001088,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000723,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.007,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005023,"exclusive_lock_hold_duration_s":0.018778399999999997,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.038383,"completed_at":"2026-06-29T22:09:32.121Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.008273,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371vm-test-run-nixbot-gitlab> gitlab # [  226.183634] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.122Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"1ee4a3325134023a983b66df","created_at":"2026-06-29T22:09:30.548Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"185cef0de0402c797fc1deb1ecf08f59","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.555Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-1ee4a3325134023a983b66df: start","job_status":"start","queue_duration_s":1.567603,"scheduling_latency_s":1.567619}1372vm-test-run-nixbot-gitlab> gitlab # [  226.197775] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.154Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"1ee4a3325134023a983b66df","created_at":"2026-06-29T22:09:30.548Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"185cef0de0402c797fc1deb1ecf08f59","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-29T22:09:30.555Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-1ee4a3325134023a983b66df: done: 0.032227 sec","job_status":"done","queue_duration_s":1.567603,"scheduling_latency_s":1.567619,"redis_calls":10,"redis_duration_s":0.001982,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.0004,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000398,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030024,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.032227,"completed_at":"2026-06-29T22:09:32.154Z","load_balancing_strategy":"primary","db_duration_s":0.010703,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373vm-test-run-nixbot-gitlab> gitlab # [  226.242143] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46e5ac6765bc326486d493f3","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46e5ac6765bc326486d493f3: start","job_status":"start","queue_duration_s":0.751722,"scheduling_latency_s":0.751738}1374vm-test-run-nixbot-gitlab> gitlab # [  226.255210] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.179Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46e5ac6765bc326486d493f3","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46e5ac6765bc326486d493f3: done: 0.02328 sec","job_status":"done","queue_duration_s":0.751722,"scheduling_latency_s":0.751738,"redis_calls":16,"redis_duration_s":0.003823,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000514,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002297,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013671,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031074,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02328,"completed_at":"2026-06-29T22:09:32.179Z","load_balancing_strategy":"primary","db_duration_s":0.000643,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375vm-test-run-nixbot-gitlab> gitlab # [  226.296820] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9572b6415ac614996be858f1","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9572b6415ac614996be858f1: start","job_status":"start","queue_duration_s":0.776308,"scheduling_latency_s":0.776324}1376vm-test-run-nixbot-gitlab> gitlab # [  226.309487] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9572b6415ac614996be858f1","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9572b6415ac614996be858f1: done: 0.016147 sec","job_status":"done","queue_duration_s":0.776308,"scheduling_latency_s":0.776324,"redis_calls":13,"redis_duration_s":0.002872,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009788,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016147,"completed_at":"2026-06-29T22:09:32.197Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377vm-test-run-nixbot-gitlab> gitlab # [  226.349043] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.198Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93e883b4e7dcd4f36cefdf5a","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93e883b4e7dcd4f36cefdf5a: start","job_status":"start","queue_duration_s":0.793984,"scheduling_latency_s":0.794}1378vm-test-run-nixbot-gitlab> gitlab # [  226.361665] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"93e883b4e7dcd4f36cefdf5a","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-93e883b4e7dcd4f36cefdf5a: done: 0.015354 sec","job_status":"done","queue_duration_s":0.793984,"scheduling_latency_s":0.794,"redis_calls":13,"redis_duration_s":0.002804,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001748,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009554,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015354,"completed_at":"2026-06-29T22:09:32.214Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379vm-test-run-nixbot-gitlab> gitlab # [  226.401284] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04b423b9ba4120152b3a7653","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04b423b9ba4120152b3a7653: start","job_status":"start","queue_duration_s":0.811332,"scheduling_latency_s":0.811349}1380vm-test-run-nixbot-gitlab> gitlab # [  226.413924] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04b423b9ba4120152b3a7653","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04b423b9ba4120152b3a7653: done: 0.015752 sec","job_status":"done","queue_duration_s":0.811332,"scheduling_latency_s":0.811349,"redis_calls":13,"redis_duration_s":0.00278,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001836,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015752,"completed_at":"2026-06-29T22:09:32.231Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381vm-test-run-nixbot-gitlab> gitlab # [  226.454823] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7470513e469958731e9493f5","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7470513e469958731e9493f5: start","job_status":"start","queue_duration_s":0.828637,"scheduling_latency_s":0.828654}1382vm-test-run-nixbot-gitlab> gitlab # [  226.467418] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7470513e469958731e9493f5","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7470513e469958731e9493f5: done: 0.015333 sec","job_status":"done","queue_duration_s":0.828637,"scheduling_latency_s":0.828654,"redis_calls":13,"redis_duration_s":0.002633,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001727,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009747,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015333,"completed_at":"2026-06-29T22:09:32.248Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383vm-test-run-nixbot-gitlab> gitlab # [  226.507277] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30798918acb831d4cc63f6bc","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30798918acb831d4cc63f6bc: start","job_status":"start","queue_duration_s":0.845623,"scheduling_latency_s":0.845638}1384vm-test-run-nixbot-gitlab> gitlab # [  226.519925] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30798918acb831d4cc63f6bc","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30798918acb831d4cc63f6bc: done: 0.01557 sec","job_status":"done","queue_duration_s":0.845623,"scheduling_latency_s":0.845638,"redis_calls":13,"redis_duration_s":0.00273,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009802,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01557,"completed_at":"2026-06-29T22:09:32.265Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385vm-test-run-nixbot-gitlab> gitlab # [  226.559668] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.267Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfbcbc067e664ef6a87ff6ad","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfbcbc067e664ef6a87ff6ad: start","job_status":"start","queue_duration_s":0.862765,"scheduling_latency_s":0.86278}1386vm-test-run-nixbot-gitlab> gitlab # [  226.572440] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.282Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfbcbc067e664ef6a87ff6ad","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfbcbc067e664ef6a87ff6ad: done: 0.015453 sec","job_status":"done","queue_duration_s":0.862765,"scheduling_latency_s":0.86278,"redis_calls":13,"redis_duration_s":0.002699,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001798,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009716,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015453,"completed_at":"2026-06-29T22:09:32.282Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387vm-test-run-nixbot-gitlab> gitlab # [  226.612023] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.284Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66976fc1390d662e794e6fc2","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66976fc1390d662e794e6fc2: start","job_status":"start","queue_duration_s":0.879732,"scheduling_latency_s":0.879748}1388vm-test-run-nixbot-gitlab> gitlab # [  226.624587] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.299Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66976fc1390d662e794e6fc2","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66976fc1390d662e794e6fc2: done: 0.015327 sec","job_status":"done","queue_duration_s":0.879732,"scheduling_latency_s":0.879748,"redis_calls":13,"redis_duration_s":0.0026680000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001773,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009708,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015327,"completed_at":"2026-06-29T22:09:32.299Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389vm-test-run-nixbot-gitlab> gitlab # [  226.665338] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94ea33761edbc3072ff6cc76","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94ea33761edbc3072ff6cc76: start","job_status":"start","queue_duration_s":0.896416,"scheduling_latency_s":0.896432}1390vm-test-run-nixbot-gitlab> gitlab # [  226.678045] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"94ea33761edbc3072ff6cc76","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-94ea33761edbc3072ff6cc76: done: 0.015854 sec","job_status":"done","queue_duration_s":0.896416,"scheduling_latency_s":0.896432,"redis_calls":13,"redis_duration_s":0.002728,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000909,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001819,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009726,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015854,"completed_at":"2026-06-29T22:09:32.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391vm-test-run-nixbot-gitlab> gitlab # [  226.718129] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.318Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63c9ee72f551cba7d18b9cd1","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63c9ee72f551cba7d18b9cd1: start","job_status":"start","queue_duration_s":0.913583,"scheduling_latency_s":0.913597}1392vm-test-run-nixbot-gitlab> gitlab # [  226.730968] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"63c9ee72f551cba7d18b9cd1","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-63c9ee72f551cba7d18b9cd1: done: 0.015453 sec","job_status":"done","queue_duration_s":0.913583,"scheduling_latency_s":0.913597,"redis_calls":13,"redis_duration_s":0.002679,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000907,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001772,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009497,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015453,"completed_at":"2026-06-29T22:09:32.333Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393vm-test-run-nixbot-gitlab> gitlab # [  226.771343] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.335Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"063cb5fd13dee58f8699190a","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-063cb5fd13dee58f8699190a: start","job_status":"start","queue_duration_s":0.930362,"scheduling_latency_s":0.930378}1394vm-test-run-nixbot-gitlab> gitlab # [  226.784308] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"063cb5fd13dee58f8699190a","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-063cb5fd13dee58f8699190a: done: 0.015936 sec","job_status":"done","queue_duration_s":0.930362,"scheduling_latency_s":0.930378,"redis_calls":13,"redis_duration_s":0.0029230000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000939,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001984,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009666,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015936,"completed_at":"2026-06-29T22:09:32.350Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1395vm-test-run-nixbot-gitlab> gitlab # [  226.824304] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.352Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7407a44b81e3dece577f836a","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7407a44b81e3dece577f836a: start","job_status":"start","queue_duration_s":0.947703,"scheduling_latency_s":0.947719}1396vm-test-run-nixbot-gitlab> gitlab # [  226.837858] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7407a44b81e3dece577f836a","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7407a44b81e3dece577f836a: done: 0.015738 sec","job_status":"done","queue_duration_s":0.947703,"scheduling_latency_s":0.947719,"redis_calls":13,"redis_duration_s":0.002702,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001808,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009564,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015738,"completed_at":"2026-06-29T22:09:32.368Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1397vm-test-run-nixbot-gitlab> gitlab # [  226.878012] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c139e666e15c48972c6921be","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c139e666e15c48972c6921be: start","job_status":"start","queue_duration_s":0.96479,"scheduling_latency_s":0.964805}1398vm-test-run-nixbot-gitlab> gitlab # [  226.890764] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c139e666e15c48972c6921be","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c139e666e15c48972c6921be: done: 0.015786 sec","job_status":"done","queue_duration_s":0.96479,"scheduling_latency_s":0.964805,"redis_calls":13,"redis_duration_s":0.002953,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001157,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001796,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009701,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015786,"completed_at":"2026-06-29T22:09:32.385Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1399vm-test-run-nixbot-gitlab> gitlab # [  226.930895] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae2d8a1ef8ce64ab48088e20","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae2d8a1ef8ce64ab48088e20: start","job_status":"start","queue_duration_s":0.982159,"scheduling_latency_s":0.982175}1400vm-test-run-nixbot-gitlab> gitlab # [  226.943755] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ae2d8a1ef8ce64ab48088e20","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ae2d8a1ef8ce64ab48088e20: done: 0.01558 sec","job_status":"done","queue_duration_s":0.982159,"scheduling_latency_s":0.982175,"redis_calls":13,"redis_duration_s":0.002789,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000911,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00959,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01558,"completed_at":"2026-06-29T22:09:32.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401vm-test-run-nixbot-gitlab> gitlab # [  226.984369] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.403Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8817d564d1ce1ed171a44ee2","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8817d564d1ce1ed171a44ee2: start","job_status":"start","queue_duration_s":0.999046,"scheduling_latency_s":0.999061}1402vm-test-run-nixbot-gitlab> gitlab # [  226.996837] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.418Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8817d564d1ce1ed171a44ee2","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8817d564d1ce1ed171a44ee2: done: 0.015103 sec","job_status":"done","queue_duration_s":0.999046,"scheduling_latency_s":0.999061,"redis_calls":13,"redis_duration_s":0.002369,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000936,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001433,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009805,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015103,"completed_at":"2026-06-29T22:09:32.418Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403vm-test-run-nixbot-gitlab> gitlab # [  227.036988] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.420Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5da1ea6c55a416b0ac8331d3","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5da1ea6c55a416b0ac8331d3: start","job_status":"start","queue_duration_s":1.015814,"scheduling_latency_s":1.01583}1404vm-test-run-nixbot-gitlab> gitlab # [  227.050822] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.436Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5da1ea6c55a416b0ac8331d3","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5da1ea6c55a416b0ac8331d3: done: 0.015567 sec","job_status":"done","queue_duration_s":1.015814,"scheduling_latency_s":1.01583,"redis_calls":13,"redis_duration_s":0.0027660000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000962,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001804,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015567,"completed_at":"2026-06-29T22:09:32.436Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405vm-test-run-nixbot-gitlab> gitlab # [  227.090987] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.437Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfcd1127d6d0cb478883029c","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfcd1127d6d0cb478883029c: start","job_status":"start","queue_duration_s":1.032803,"scheduling_latency_s":1.032819}1406vm-test-run-nixbot-gitlab> gitlab # [  227.103735] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.452Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cfcd1127d6d0cb478883029c","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cfcd1127d6d0cb478883029c: done: 0.015214 sec","job_status":"done","queue_duration_s":1.032803,"scheduling_latency_s":1.032819,"redis_calls":13,"redis_duration_s":0.002486,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001591,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015214,"completed_at":"2026-06-29T22:09:32.452Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407vm-test-run-nixbot-gitlab> gitlab # [  227.143851] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03ff58d24ad8c4b7087aea82","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03ff58d24ad8c4b7087aea82: start","job_status":"start","queue_duration_s":1.049509,"scheduling_latency_s":1.049524}1408vm-test-run-nixbot-gitlab> gitlab # [  227.156589] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.470Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"03ff58d24ad8c4b7087aea82","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-03ff58d24ad8c4b7087aea82: done: 0.015835 sec","job_status":"done","queue_duration_s":1.049509,"scheduling_latency_s":1.049524,"redis_calls":13,"redis_duration_s":0.002921,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001802,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010101,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015835,"completed_at":"2026-06-29T22:09:32.470Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409vm-test-run-nixbot-gitlab> gitlab # [  227.196573] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.472Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c32c0fcbb555245d0bf77d","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c32c0fcbb555245d0bf77d: start","job_status":"start","queue_duration_s":1.068188,"scheduling_latency_s":1.068206}1410vm-test-run-nixbot-gitlab> gitlab # [  227.209208] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.491Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"36c32c0fcbb555245d0bf77d","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-36c32c0fcbb555245d0bf77d: done: 0.018185 sec","job_status":"done","queue_duration_s":1.068188,"scheduling_latency_s":1.068206,"redis_calls":13,"redis_duration_s":0.003849,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000805,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003044,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018185,"completed_at":"2026-06-29T22:09:32.491Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411vm-test-run-nixbot-gitlab> gitlab # [  227.249681] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.493Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31b02fd7534975c36d20f85d","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31b02fd7534975c36d20f85d: start","job_status":"start","queue_duration_s":1.088283,"scheduling_latency_s":1.0883}1412vm-test-run-nixbot-gitlab> gitlab # [  227.262679] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31b02fd7534975c36d20f85d","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31b02fd7534975c36d20f85d: done: 0.024956 sec","job_status":"done","queue_duration_s":1.088283,"scheduling_latency_s":1.0883,"redis_calls":13,"redis_duration_s":0.011159,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000732,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.010427,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010705,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024956,"completed_at":"2026-06-29T22:09:32.517Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413vm-test-run-nixbot-gitlab> gitlab # [  227.302962] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.519Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a64187e2d32cd10bd7fec9a","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a64187e2d32cd10bd7fec9a: start","job_status":"start","queue_duration_s":1.114621,"scheduling_latency_s":1.114638}1414vm-test-run-nixbot-gitlab> gitlab # [  227.315687] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.534Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3a64187e2d32cd10bd7fec9a","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3a64187e2d32cd10bd7fec9a: done: 0.015152 sec","job_status":"done","queue_duration_s":1.114621,"scheduling_latency_s":1.114638,"redis_calls":13,"redis_duration_s":0.001549,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010142,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015152,"completed_at":"2026-06-29T22:09:32.534Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415vm-test-run-nixbot-gitlab> gitlab # [  227.355698] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dc820a7fe2480bd2fbe4a6a","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dc820a7fe2480bd2fbe4a6a: start","job_status":"start","queue_duration_s":1.130865,"scheduling_latency_s":1.130882}1416vm-test-run-nixbot-gitlab> gitlab # [  227.368657] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.550Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5dc820a7fe2480bd2fbe4a6a","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5dc820a7fe2480bd2fbe4a6a: done: 0.015285 sec","job_status":"done","queue_duration_s":1.130865,"scheduling_latency_s":1.130882,"redis_calls":13,"redis_duration_s":0.001619,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000557,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001062,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010255,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015285,"completed_at":"2026-06-29T22:09:32.550Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1417vm-test-run-nixbot-gitlab> gitlab # [  227.408517] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.552Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b68558c79dfc242c9970cf7","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b68558c79dfc242c9970cf7: start","job_status":"start","queue_duration_s":1.147309,"scheduling_latency_s":1.147326}1418vm-test-run-nixbot-gitlab> gitlab # [  227.421194] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b68558c79dfc242c9970cf7","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b68558c79dfc242c9970cf7: done: 0.014581 sec","job_status":"done","queue_duration_s":1.147309,"scheduling_latency_s":1.147326,"redis_calls":13,"redis_duration_s":0.0015240000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000559,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000965,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009955,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014581,"completed_at":"2026-06-29T22:09:32.566Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1419vm-test-run-nixbot-gitlab> gitlab # [  227.462061] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.567Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55266e7b265fc35eeab318db","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55266e7b265fc35eeab318db: start","job_status":"start","queue_duration_s":1.163128,"scheduling_latency_s":1.163145}1420vm-test-run-nixbot-gitlab> gitlab # [  227.474547] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"55266e7b265fc35eeab318db","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-55266e7b265fc35eeab318db: done: 0.014775 sec","job_status":"done","queue_duration_s":1.163128,"scheduling_latency_s":1.163145,"redis_calls":13,"redis_duration_s":0.001577,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000549,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001028,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010118,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014775,"completed_at":"2026-06-29T22:09:32.582Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421vm-test-run-nixbot-gitlab> gitlab # [  227.514466] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dae6c7cc7a3c4b3e3cf3e7eb","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dae6c7cc7a3c4b3e3cf3e7eb: start","job_status":"start","queue_duration_s":1.179162,"scheduling_latency_s":1.179178}1422vm-test-run-nixbot-gitlab> gitlab # [  227.527216] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dae6c7cc7a3c4b3e3cf3e7eb","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dae6c7cc7a3c4b3e3cf3e7eb: done: 0.015003 sec","job_status":"done","queue_duration_s":1.179162,"scheduling_latency_s":1.179178,"redis_calls":13,"redis_duration_s":0.00157,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000578,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000992,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015003,"completed_at":"2026-06-29T22:09:32.598Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1423vm-test-run-nixbot-gitlab> gitlab # [  227.567041] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.600Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1854c69d5c8a1441877b3694","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1854c69d5c8a1441877b3694: start","job_status":"start","queue_duration_s":1.19546,"scheduling_latency_s":1.195476}1424vm-test-run-nixbot-gitlab> gitlab # [  227.579671] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1854c69d5c8a1441877b3694","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1854c69d5c8a1441877b3694: done: 0.014716 sec","job_status":"done","queue_duration_s":1.19546,"scheduling_latency_s":1.195476,"redis_calls":13,"redis_duration_s":0.0014810000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000955,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010205,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014716,"completed_at":"2026-06-29T22:09:32.614Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1425vm-test-run-nixbot-gitlab> gitlab # [  227.619765] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.616Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8da152e003a23a9633fd9b6a","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8da152e003a23a9633fd9b6a: start","job_status":"start","queue_duration_s":1.211466,"scheduling_latency_s":1.211481}1426vm-test-run-nixbot-gitlab> gitlab # [  227.632660] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.631Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8da152e003a23a9633fd9b6a","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8da152e003a23a9633fd9b6a: done: 0.015272 sec","job_status":"done","queue_duration_s":1.211466,"scheduling_latency_s":1.211481,"redis_calls":13,"redis_duration_s":0.001532,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000978,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010617,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015272,"completed_at":"2026-06-29T22:09:32.631Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1427vm-test-run-nixbot-gitlab> gitlab # [  227.674141] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b708e853759e4dadcaa26ecf","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b708e853759e4dadcaa26ecf: start","job_status":"start","queue_duration_s":1.22813,"scheduling_latency_s":1.228147}1428vm-test-run-nixbot-gitlab> gitlab # [  227.687127] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b708e853759e4dadcaa26ecf","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b708e853759e4dadcaa26ecf: done: 0.014735 sec","job_status":"done","queue_duration_s":1.22813,"scheduling_latency_s":1.228147,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000548,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010298,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014735,"completed_at":"2026-06-29T22:09:32.647Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1429vm-test-run-nixbot-gitlab> gitlab # [  227.728096] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b999466bc169504378cf4e40","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b999466bc169504378cf4e40: start","job_status":"start","queue_duration_s":1.244174,"scheduling_latency_s":1.24419}1430vm-test-run-nixbot-gitlab> gitlab # [  227.740927] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b999466bc169504378cf4e40","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b999466bc169504378cf4e40: done: 0.014773 sec","job_status":"done","queue_duration_s":1.244174,"scheduling_latency_s":1.24419,"redis_calls":13,"redis_duration_s":0.001648,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000542,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001106,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010147,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014773,"completed_at":"2026-06-29T22:09:32.663Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1431vm-test-run-nixbot-gitlab> gitlab # [  227.781600] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.664Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c57ee131e05a50a7987b480c","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c57ee131e05a50a7987b480c: start","job_status":"start","queue_duration_s":1.260156,"scheduling_latency_s":1.260173}1432vm-test-run-nixbot-gitlab> gitlab # [  227.794635] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c57ee131e05a50a7987b480c","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c57ee131e05a50a7987b480c: done: 0.014978 sec","job_status":"done","queue_duration_s":1.260156,"scheduling_latency_s":1.260173,"redis_calls":13,"redis_duration_s":0.001627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001104,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010273,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014978,"completed_at":"2026-06-29T22:09:32.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1433vm-test-run-nixbot-gitlab> gitlab # [  227.835754] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0318bc18917e9fda2abe530","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0318bc18917e9fda2abe530: start","job_status":"start","queue_duration_s":1.276234,"scheduling_latency_s":1.276251}1434vm-test-run-nixbot-gitlab> gitlab # [  227.874027] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f0318bc18917e9fda2abe530","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f0318bc18917e9fda2abe530: done: 0.015085 sec","job_status":"done","queue_duration_s":1.276234,"scheduling_latency_s":1.276251,"redis_calls":13,"redis_duration_s":0.0018189999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000697,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001122,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015085,"completed_at":"2026-06-29T22:09:32.696Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1435vm-test-run-nixbot-gitlab> gitlab # [  227.953040] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.697Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83ece288833e706f21cc7509","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83ece288833e706f21cc7509: start","job_status":"start","queue_duration_s":1.292615,"scheduling_latency_s":1.292632}1436vm-test-run-nixbot-gitlab> gitlab # [  227.968410] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.712Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"83ece288833e706f21cc7509","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-83ece288833e706f21cc7509: done: 0.015235 sec","job_status":"done","queue_duration_s":1.292615,"scheduling_latency_s":1.292632,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000565,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00093,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015235,"completed_at":"2026-06-29T22:09:32.712Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1437vm-test-run-nixbot-gitlab> gitlab # [  228.009879] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.713Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54951f6285e66f4a12c7d1b2","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54951f6285e66f4a12c7d1b2: start","job_status":"start","queue_duration_s":1.30894,"scheduling_latency_s":1.308957}1438vm-test-run-nixbot-gitlab> gitlab # [  228.022734] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.894Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54951f6285e66f4a12c7d1b2","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54951f6285e66f4a12c7d1b2: done: 0.181117 sec","job_status":"done","queue_duration_s":1.30894,"scheduling_latency_s":1.308957,"redis_calls":13,"redis_duration_s":0.002052,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001091,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.181117,"completed_at":"2026-06-29T22:09:32.894Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1439vm-test-run-nixbot-gitlab> gitlab # [  228.063343] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.899Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"858a9c64fa8fcedd9cfd8ef1","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-858a9c64fa8fcedd9cfd8ef1: start","job_status":"start","queue_duration_s":1.494364,"scheduling_latency_s":1.494407}1440vm-test-run-nixbot-gitlab> gitlab # [  228.076183] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"858a9c64fa8fcedd9cfd8ef1","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-858a9c64fa8fcedd9cfd8ef1: done: 0.03966 sec","job_status":"done","queue_duration_s":1.494364,"scheduling_latency_s":1.494407,"redis_calls":13,"redis_duration_s":0.005039,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00153,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003509,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026776,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.03966,"completed_at":"2026-06-29T22:09:32.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1441vm-test-run-nixbot-gitlab> gitlab # [  228.116975] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.942Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e6cc17c785eb8c6c6861531","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e6cc17c785eb8c6c6861531: start","job_status":"start","queue_duration_s":1.537219,"scheduling_latency_s":1.537253}1442vm-test-run-nixbot-gitlab> gitlab # [  228.129719] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.971Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e6cc17c785eb8c6c6861531","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e6cc17c785eb8c6c6861531: done: 0.029723 sec","job_status":"done","queue_duration_s":1.537219,"scheduling_latency_s":1.537253,"redis_calls":13,"redis_duration_s":0.003634,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001244,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00239,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019319,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029723,"completed_at":"2026-06-29T22:09:32.971Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1443vm-test-run-nixbot-gitlab> gitlab # [  228.169794] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaf4fa3f293df6a4c6ba7217","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaf4fa3f293df6a4c6ba7217: start","job_status":"start","queue_duration_s":1.569117,"scheduling_latency_s":1.56914}1444vm-test-run-nixbot-gitlab> gitlab # [  228.182688] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaf4fa3f293df6a4c6ba7217","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaf4fa3f293df6a4c6ba7217: done: 0.02143 sec","job_status":"done","queue_duration_s":1.569117,"scheduling_latency_s":1.56914,"redis_calls":13,"redis_duration_s":0.0031399999999999996,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00107,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00207,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013958,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02143,"completed_at":"2026-06-29T22:09:32.995Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445vm-test-run-nixbot-gitlab> gitlab # [  228.222900] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:32.997Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e55f292a873769f759e825e6","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e55f292a873769f759e825e6: start","job_status":"start","queue_duration_s":1.592281,"scheduling_latency_s":1.592302}1446vm-test-run-nixbot-gitlab> gitlab # [  228.235697] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e55f292a873769f759e825e6","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e55f292a873769f759e825e6: done: 0.018135 sec","job_status":"done","queue_duration_s":1.592281,"scheduling_latency_s":1.592302,"redis_calls":13,"redis_duration_s":0.002797,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001012,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001785,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011706,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018135,"completed_at":"2026-06-29T22:09:33.015Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447vm-test-run-nixbot-gitlab> gitlab # [  228.276478] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.016Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2421d2edf4418c761145ee5","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2421d2edf4418c761145ee5: start","job_status":"start","queue_duration_s":1.612147,"scheduling_latency_s":1.612165}1448vm-test-run-nixbot-gitlab> gitlab # [  228.289983] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2421d2edf4418c761145ee5","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2421d2edf4418c761145ee5: done: 0.017934 sec","job_status":"done","queue_duration_s":1.612147,"scheduling_latency_s":1.612165,"redis_calls":13,"redis_duration_s":0.003084,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002079,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017934,"completed_at":"2026-06-29T22:09:33.034Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449vm-test-run-nixbot-gitlab> gitlab # [  228.330384] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"880582382182106b515d21c3","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-880582382182106b515d21c3: start","job_status":"start","queue_duration_s":1.631567,"scheduling_latency_s":1.631584}1450vm-test-run-nixbot-gitlab> gitlab # [  228.343273] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.055Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"880582382182106b515d21c3","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-880582382182106b515d21c3: done: 0.019265 sec","job_status":"done","queue_duration_s":1.631567,"scheduling_latency_s":1.631584,"redis_calls":13,"redis_duration_s":0.00341,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000998,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002412,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019265,"completed_at":"2026-06-29T22:09:33.055Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451vm-test-run-nixbot-gitlab> gitlab # [  228.383507] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.057Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c76a6370a74ce8d23c718aa","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c76a6370a74ce8d23c718aa: start","job_status":"start","queue_duration_s":1.652335,"scheduling_latency_s":1.652352}1452vm-test-run-nixbot-gitlab> gitlab # [  228.396466] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.074Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5c76a6370a74ce8d23c718aa","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5c76a6370a74ce8d23c718aa: done: 0.017543 sec","job_status":"done","queue_duration_s":1.652335,"scheduling_latency_s":1.652352,"redis_calls":13,"redis_duration_s":0.002807,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000914,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001893,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017543,"completed_at":"2026-06-29T22:09:33.074Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453vm-test-run-nixbot-gitlab> gitlab # [  228.436653] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.076Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8f7aeaeb98b36918a3b01ea","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8f7aeaeb98b36918a3b01ea: start","job_status":"start","queue_duration_s":1.671414,"scheduling_latency_s":1.67143}1454vm-test-run-nixbot-gitlab> gitlab # [  228.449145] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.093Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8f7aeaeb98b36918a3b01ea","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8f7aeaeb98b36918a3b01ea: done: 0.017182 sec","job_status":"done","queue_duration_s":1.671414,"scheduling_latency_s":1.67143,"redis_calls":13,"redis_duration_s":0.00285,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000959,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001891,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010586,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017182,"completed_at":"2026-06-29T22:09:33.093Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455vm-test-run-nixbot-gitlab> gitlab # [  228.489928] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb36ed1f7579a5b807d57e47","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb36ed1f7579a5b807d57e47: start","job_status":"start","queue_duration_s":1.690127,"scheduling_latency_s":1.690142}1456vm-test-run-nixbot-gitlab> gitlab # [  228.502783] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cb36ed1f7579a5b807d57e47","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cb36ed1f7579a5b807d57e47: done: 0.01569 sec","job_status":"done","queue_duration_s":1.690127,"scheduling_latency_s":1.690142,"redis_calls":13,"redis_duration_s":0.002692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00178,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009687,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01569,"completed_at":"2026-06-29T22:09:33.110Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457vm-test-run-nixbot-gitlab> gitlab # [  228.542854] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.112Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10d87f7c45d35c3c6ff4bb65","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10d87f7c45d35c3c6ff4bb65: start","job_status":"start","queue_duration_s":1.707234,"scheduling_latency_s":1.707251}1458vm-test-run-nixbot-gitlab> gitlab # [  228.555834] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.127Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"10d87f7c45d35c3c6ff4bb65","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-10d87f7c45d35c3c6ff4bb65: done: 0.01587 sec","job_status":"done","queue_duration_s":1.707234,"scheduling_latency_s":1.707251,"redis_calls":13,"redis_duration_s":0.0029969999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001256,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001741,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009557,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01587,"completed_at":"2026-06-29T22:09:33.127Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459vm-test-run-nixbot-gitlab> gitlab # [  228.596583] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da647e8bcfdd240b416ded98","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da647e8bcfdd240b416ded98: start","job_status":"start","queue_duration_s":1.724562,"scheduling_latency_s":1.724577}1460vm-test-run-nixbot-gitlab> gitlab # [  228.609254] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.144Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da647e8bcfdd240b416ded98","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da647e8bcfdd240b416ded98: done: 0.015679 sec","job_status":"done","queue_duration_s":1.724562,"scheduling_latency_s":1.724577,"redis_calls":13,"redis_duration_s":0.002729,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000982,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001747,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009648,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015679,"completed_at":"2026-06-29T22:09:33.144Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461vm-test-run-nixbot-gitlab> gitlab # [  228.649566] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.146Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8bb48667eb758f04ced1cbc","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8bb48667eb758f04ced1cbc: start","job_status":"start","queue_duration_s":1.741927,"scheduling_latency_s":1.741942}1462vm-test-run-nixbot-gitlab> gitlab # [  228.662124] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.162Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f8bb48667eb758f04ced1cbc","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f8bb48667eb758f04ced1cbc: done: 0.015367 sec","job_status":"done","queue_duration_s":1.741927,"scheduling_latency_s":1.741942,"redis_calls":13,"redis_duration_s":0.002674,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001759,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009725,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015367,"completed_at":"2026-06-29T22:09:33.161Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463vm-test-run-nixbot-gitlab> gitlab # [  228.703144] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.163Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d4de9bba241f4fbe2f0eaa0","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d4de9bba241f4fbe2f0eaa0: start","job_status":"start","queue_duration_s":1.758839,"scheduling_latency_s":1.758854}1464vm-test-run-nixbot-gitlab> gitlab # [  228.716115] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.180Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9d4de9bba241f4fbe2f0eaa0","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9d4de9bba241f4fbe2f0eaa0: done: 0.016592 sec","job_status":"done","queue_duration_s":1.758839,"scheduling_latency_s":1.758854,"redis_calls":13,"redis_duration_s":0.0031,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001202,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010233,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016592,"completed_at":"2026-06-29T22:09:33.180Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465vm-test-run-nixbot-gitlab> gitlab # [  228.756275] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.181Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2bda24b43c7a1084396ca9c","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2bda24b43c7a1084396ca9c: start","job_status":"start","queue_duration_s":1.77699,"scheduling_latency_s":1.777005}1466vm-test-run-nixbot-gitlab> gitlab # [  228.768800] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.197Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b2bda24b43c7a1084396ca9c","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b2bda24b43c7a1084396ca9c: done: 0.015659 sec","job_status":"done","queue_duration_s":1.77699,"scheduling_latency_s":1.777005,"redis_calls":13,"redis_duration_s":0.002827,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001929,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015659,"completed_at":"2026-06-29T22:09:33.197Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467vm-test-run-nixbot-gitlab> gitlab # [  228.808877] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.199Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"771c6d311e1c460a475d3e3e","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-771c6d311e1c460a475d3e3e: start","job_status":"start","queue_duration_s":1.794276,"scheduling_latency_s":1.794293}1468vm-test-run-nixbot-gitlab> gitlab # [  228.821807] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.214Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"771c6d311e1c460a475d3e3e","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-771c6d311e1c460a475d3e3e: done: 0.015726 sec","job_status":"done","queue_duration_s":1.794276,"scheduling_latency_s":1.794293,"redis_calls":13,"redis_duration_s":0.002687,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000929,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009806,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015726,"completed_at":"2026-06-29T22:09:33.214Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469vm-test-run-nixbot-gitlab> gitlab # [  228.861799] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39a4b3769c34406cf1222d14","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39a4b3769c34406cf1222d14: start","job_status":"start","queue_duration_s":1.811278,"scheduling_latency_s":1.811292}1470vm-test-run-nixbot-gitlab> gitlab # [  228.874601] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.232Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39a4b3769c34406cf1222d14","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39a4b3769c34406cf1222d14: done: 0.016865 sec","job_status":"done","queue_duration_s":1.811278,"scheduling_latency_s":1.811292,"redis_calls":13,"redis_duration_s":0.0035380000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000969,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002569,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010222,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016865,"completed_at":"2026-06-29T22:09:33.232Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471vm-test-run-nixbot-gitlab> gitlab # [  228.915969] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.234Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9a86f3abf76a30a906dda13","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9a86f3abf76a30a906dda13: start","job_status":"start","queue_duration_s":1.829671,"scheduling_latency_s":1.829689}1472vm-test-run-nixbot-gitlab> gitlab # [  228.928790] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.250Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d9a86f3abf76a30a906dda13","created_at":"2026-06-29T22:09:31.324Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-5a490dabc9fd43fc","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"0de18cbc11dd83d6bb3112413d4a307d","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.404Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d9a86f3abf76a30a906dda13: done: 0.015827 sec","job_status":"done","queue_duration_s":1.829671,"scheduling_latency_s":1.829689,"redis_calls":13,"redis_duration_s":0.002858,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00095,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009738,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015827,"completed_at":"2026-06-29T22:09:33.250Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473vm-test-run-nixbot-gitlab> gitlab # [  228.969027] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.251Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"06db195d969c0ce28d02229d","created_at":"2026-06-29T22:09:31.459Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-149627c5cba54adb","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a743239a1a36887552e58a3dfb0cfc2b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.473Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-06db195d969c0ce28d02229d: start","job_status":"start","queue_duration_s":1.777627,"scheduling_latency_s":1.777643}1474vm-test-run-nixbot-gitlab> gitlab # [  228.981700] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.270Z","message":"No existing merge request to be cleaned up."}1475vm-test-run-nixbot-gitlab> gitlab # [  228.983412] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.285Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"06db195d969c0ce28d02229d","created_at":"2026-06-29T22:09:31.459Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-149627c5cba54adb","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a743239a1a36887552e58a3dfb0cfc2b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.473Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-06db195d969c0ce28d02229d: done: 0.034092 sec","job_status":"done","queue_duration_s":1.777627,"scheduling_latency_s":1.777643,"redis_calls":13,"redis_duration_s":0.003396,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000605,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001253,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001538,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019247,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038966,"duration_s":0.034092,"completed_at":"2026-06-29T22:09:33.285Z","load_balancing_strategy":"primary","db_duration_s":0.006888,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1476vm-test-run-nixbot-gitlab> gitlab # [  229.025065] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.287Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e5acbc94cc515c9919a4ff48","created_at":"2026-06-29T22:09:31.459Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-149627c5cba54adb","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a743239a1a36887552e58a3dfb0cfc2b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.473Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e5acbc94cc515c9919a4ff48: start","job_status":"start","queue_duration_s":1.813296,"scheduling_latency_s":1.813312}1477vm-test-run-nixbot-gitlab> gitlab # [  229.037581] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.298Z","message":"No existing merge request to be cleaned up."}1478vm-test-run-nixbot-gitlab> gitlab # [  229.039261] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.307Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"e5acbc94cc515c9919a4ff48","created_at":"2026-06-29T22:09:31.459Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-149627c5cba54adb","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a743239a1a36887552e58a3dfb0cfc2b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.473Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-e5acbc94cc515c9919a4ff48: done: 0.019996 sec","job_status":"done","queue_duration_s":1.813296,"scheduling_latency_s":1.813312,"redis_calls":10,"redis_duration_s":0.0025859999999999998,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001101,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001485,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012443,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019996,"completed_at":"2026-06-29T22:09:33.307Z","load_balancing_strategy":"primary","db_duration_s":0.002802,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479vm-test-run-nixbot-gitlab> gitlab # [  229.078392] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.308Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a3901a1f2b8b2e6b7ef97d4f","created_at":"2026-06-29T22:09:31.459Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-149627c5cba54adb","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a743239a1a36887552e58a3dfb0cfc2b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.473Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a3901a1f2b8b2e6b7ef97d4f: start","job_status":"start","queue_duration_s":1.834892,"scheduling_latency_s":1.834909}1480vm-test-run-nixbot-gitlab> gitlab # [  229.090959] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.320Z","message":"No existing merge request to be cleaned up."}1481vm-test-run-nixbot-gitlab> gitlab # [  229.092688] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.329Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"a3901a1f2b8b2e6b7ef97d4f","created_at":"2026-06-29T22:09:31.459Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-149627c5cba54adb","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a743239a1a36887552e58a3dfb0cfc2b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.473Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-a3901a1f2b8b2e6b7ef97d4f: done: 0.020767 sec","job_status":"done","queue_duration_s":1.834892,"scheduling_latency_s":1.834909,"redis_calls":10,"redis_duration_s":0.003098,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001106,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001992,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01307,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020767,"completed_at":"2026-06-29T22:09:33.329Z","load_balancing_strategy":"primary","db_duration_s":0.002538,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1482vm-test-run-nixbot-gitlab> gitlab # [  229.132696] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.331Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"47fc3798c93476423a91a71d","created_at":"2026-06-29T22:09:31.459Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-149627c5cba54adb","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a743239a1a36887552e58a3dfb0cfc2b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.473Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-47fc3798c93476423a91a71d: start","job_status":"start","queue_duration_s":1.857246,"scheduling_latency_s":1.857261}1483vm-test-run-nixbot-gitlab> gitlab # [  229.145269] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.342Z","message":"No existing merge request to be cleaned up."}1484vm-test-run-nixbot-gitlab> gitlab # [  229.146948] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:09:33.350Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"47fc3798c93476423a91a71d","created_at":"2026-06-29T22:09:31.459Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-149627c5cba54adb","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"a743239a1a36887552e58a3dfb0cfc2b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:09:31.473Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-47fc3798c93476423a91a71d: done: 0.019716 sec","job_status":"done","queue_duration_s":1.857246,"scheduling_latency_s":1.857261,"redis_calls":10,"redis_duration_s":0.002576,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001077,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001499,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012355,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019716,"completed_at":"2026-06-29T22:09:33.350Z","load_balancing_strategy":"primary","db_duration_s":0.002621,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485vm-test-run-nixbot-gitlab> gitlab # [  257.514452] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:04.380Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"c28e0a804d4e0256fa0fb197","created_at":"2026-06-29T22:10:04.289Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab9836316e358382dd93664481ab6a69","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.376Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-c28e0a804d4e0256fa0fb197: start","job_status":"start","queue_duration_s":0.004038,"scheduling_latency_s":0.004095}1486vm-test-run-nixbot-gitlab> gitlab # [  257.867405] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:04.733Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"c28e0a804d4e0256fa0fb197","created_at":"2026-06-29T22:10:04.289Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab9836316e358382dd93664481ab6a69","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.376Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-c28e0a804d4e0256fa0fb197: done: 0.35385 sec","job_status":"done","queue_duration_s":0.004038,"scheduling_latency_s":0.004095,"redis_calls":10,"redis_duration_s":0.014456,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002138,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006885,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.005433,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00143904,"duration_s":0.35385,"completed_at":"2026-06-29T22:10:04.733Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.140951,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487vm-test-run-nixbot-gitlab> gitlab # [  257.945855] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:04.743Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a594939005749e7ee0a817fc","created_at":"2026-06-29T22:10:04.440Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e22c27e3ef771d29de4d52b20164ed9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.445Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a594939005749e7ee0a817fc: start","job_status":"start","queue_duration_s":0.298021,"scheduling_latency_s":0.29807}1488vm-test-run-nixbot-gitlab> gitlab # [  258.795142] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.661Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"a594939005749e7ee0a817fc","created_at":"2026-06-29T22:10:04.440Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9e22c27e3ef771d29de4d52b20164ed9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.445Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-a594939005749e7ee0a817fc: done: 0.917675 sec","job_status":"done","queue_duration_s":0.298021,"scheduling_latency_s":0.29807,"redis_calls":11,"redis_duration_s":0.016024,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.003469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.006123,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.006432,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":124,"db_write_count":0,"db_cached_count":80,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":124,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":80,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.226,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":124,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":80,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.226,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.446393,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00541792,"exclusive_lock_hold_duration_s":0.83081912,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.917675,"completed_at":"2026-06-29T22:10:05.661Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.462117,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489vm-test-run-nixbot-gitlab> gitlab # [  258.795676] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.662Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a3e35153540e059b25787e15","created_at":"2026-06-29T22:10:04.457Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c87812c56c88fb4f2c49506d2c3ced66","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.473Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a3e35153540e059b25787e15: start","job_status":"start","queue_duration_s":1.189431,"scheduling_latency_s":1.189452}1490vm-test-run-nixbot-gitlab> gitlab # [  258.893414] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.681Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"a3e35153540e059b25787e15","created_at":"2026-06-29T22:10:04.457Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c87812c56c88fb4f2c49506d2c3ced66","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.473Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-a3e35153540e059b25787e15: done: 0.018604 sec","job_status":"done","queue_duration_s":1.189431,"scheduling_latency_s":1.189452,"redis_calls":9,"redis_duration_s":0.002351,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001236,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001115,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01127,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0006529,"exclusive_lock_hold_duration_s":0.00298206,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.018604,"completed_at":"2026-06-29T22:10:05.681Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00117,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491vm-test-run-nixbot-gitlab> gitlab # [  259.621160] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.682Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5d4c8990fce1248c0a9b1239","created_at":"2026-06-29T22:10:04.505Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0f189e7727fa8cd7c101ba9f3ccff90","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.517Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5d4c8990fce1248c0a9b1239: start","job_status":"start","queue_duration_s":1.165739,"scheduling_latency_s":1.165755}1492vm-test-run-nixbot-gitlab> gitlab # [  259.621392] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.697Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"5d4c8990fce1248c0a9b1239","created_at":"2026-06-29T22:10:04.505Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f0f189e7727fa8cd7c101ba9f3ccff90","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.517Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-5d4c8990fce1248c0a9b1239: done: 0.015042 sec","job_status":"done","queue_duration_s":1.165739,"scheduling_latency_s":1.165755,"redis_calls":7,"redis_duration_s":0.001631,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000436,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015042,"completed_at":"2026-06-29T22:10:05.697Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000799,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493vm-test-run-nixbot-gitlab> gitlab # [  260.291899] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.699Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"acc6eab33b322f7fd4ef09b3","created_at":"2026-06-29T22:10:04.526Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"615e08d77797aae251dc13dcd5ea13f5","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.541Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-acc6eab33b322f7fd4ef09b3: start","job_status":"start","queue_duration_s":1.158211,"scheduling_latency_s":1.158227}1494vm-test-run-nixbot-gitlab> gitlab # [  260.292384] setup-gitlab-start[3311]: W, [2026-06-29T22:10:05.839599 #3311]  WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1495vm-test-run-nixbot-gitlab> gitlab # [  260.292498] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::StaleRequestsCleanupCronWorker","jid":"acc6eab33b322f7fd4ef09b3","created_at":"2026-06-29T22:10:04.526Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"615e08d77797aae251dc13dcd5ea13f5","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:73d233265a8deedc9c2e88dc2f4303db4adf3b844f30d267f04d632004c6c278","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.541Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::StaleRequestsCleanupCronWorker JID-acc6eab33b322f7fd4ef09b3: done: 0.021508 sec","job_status":"done","queue_duration_s":1.158211,"scheduling_latency_s":1.158227,"redis_calls":11,"redis_duration_s":0.002694,"redis_read_bytes":9,"redis_write_bytes":1174,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000462,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001356,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":582,"redis_rate_limiting_calls":1,"redis_rate_limiting_duration_s":0.000312,"redis_rate_limiting_write_bytes":51,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":224,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031734,"extra.cells_stale_requests_cleanup_cron_worker.removed_count":0,"duration_s":0.021508,"completed_at":"2026-06-29T22:10:05.720Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000312,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1496vm-test-run-nixbot-gitlab> gitlab # [  261.050122] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.722Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5c36476cd13ed05c073f5faf","created_at":"2026-06-29T22:10:04.555Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79533376b1301cd32a50cd7320c4fc4d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-29T22:10:04.559Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5c36476cd13ed05c073f5faf: start","job_status":"start","queue_duration_s":1.16255,"scheduling_latency_s":1.162565}1497vm-test-run-nixbot-gitlab> gitlab # [  261.068389] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.744Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"5c36476cd13ed05c073f5faf","created_at":"2026-06-29T22:10:04.555Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"79533376b1301cd32a50cd7320c4fc4d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-06-29T22:10:04.559Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-5c36476cd13ed05c073f5faf: done: 0.02192 sec","job_status":"done","queue_duration_s":1.16255,"scheduling_latency_s":1.162565,"redis_calls":8,"redis_duration_s":0.001935,"redis_read_bytes":133,"redis_write_bytes":811,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000229,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":70,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000446,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015478,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02192,"completed_at":"2026-06-29T22:10:05.744Z","load_balancing_strategy":"primary","db_duration_s":0.001364,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1498vm-test-run-nixbot-gitlab> gitlab # [  261.111988] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"b0af23aac240eca60298fffd","created_at":"2026-06-29T22:10:04.569Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e377a08dd0b8a2492201490b11bb675","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.578Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-b0af23aac240eca60298fffd: start","job_status":"start","queue_duration_s":1.166899,"scheduling_latency_s":1.166914}1499vm-test-run-nixbot-gitlab> gitlab # [  261.125612] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.770Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivatedDeploymentsDeleteCronWorker","jid":"b0af23aac240eca60298fffd","created_at":"2026-06-29T22:10:04.569Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2e377a08dd0b8a2492201490b11bb675","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:02dc87c01bb5b1cecbe6eae0009120537d166f4adbbb83ef540bec12f0f9136a","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.578Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivatedDeploymentsDeleteCronWorker JID-b0af23aac240eca60298fffd: done: 0.024627 sec","job_status":"done","queue_duration_s":1.166899,"scheduling_latency_s":1.166914,"redis_calls":10,"redis_duration_s":0.002245,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000475,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00132,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00045,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014213,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031616,"duration_s":0.024627,"completed_at":"2026-06-29T22:10:05.770Z","load_balancing_strategy":"primary","db_duration_s":0.003014,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1500vm-test-run-nixbot-gitlab> gitlab # [  261.167290] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.771Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"e5b9f0df280ba3a44cd3ae2f","created_at":"2026-06-29T22:10:04.588Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a24b56b875908925beb7c2ee8d9dacf1","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.595Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-e5b9f0df280ba3a44cd3ae2f: start","job_status":"start","queue_duration_s":1.17584,"scheduling_latency_s":1.175855}1501vm-test-run-nixbot-gitlab> gitlab # [  261.181700] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.791Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"e5b9f0df280ba3a44cd3ae2f","created_at":"2026-06-29T22:10:04.588Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a24b56b875908925beb7c2ee8d9dacf1","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.595Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-e5b9f0df280ba3a44cd3ae2f: done: 0.019768 sec","job_status":"done","queue_duration_s":1.17584,"scheduling_latency_s":1.175855,"redis_calls":12,"redis_duration_s":0.002827,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000561,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000443,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000483,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011922,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00030428,"duration_s":0.019768,"completed_at":"2026-06-29T22:10:05.791Z","load_balancing_strategy":"primary","db_duration_s":0.000534,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1502vm-test-run-nixbot-gitlab> gitlab # [  261.224406] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.792Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c30c6414ffefea5dca66299e","created_at":"2026-06-29T22:10:04.629Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab2366092050eaedccf69b13b1aec17b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.632Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c30c6414ffefea5dca66299e: start","job_status":"start","queue_duration_s":1.160568,"scheduling_latency_s":1.160583}1503vm-test-run-nixbot-gitlab> gitlab # [  261.239182] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.800Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1504vm-test-run-nixbot-gitlab> gitlab # [  261.243154] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.806Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"c30c6414ffefea5dca66299e","created_at":"2026-06-29T22:10:04.629Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ab2366092050eaedccf69b13b1aec17b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.632Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-c30c6414ffefea5dca66299e: done: 0.013364 sec","job_status":"done","queue_duration_s":1.160568,"scheduling_latency_s":1.160583,"redis_calls":7,"redis_duration_s":0.001652,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001195,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000457,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008365,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013364,"completed_at":"2026-06-29T22:10:05.806Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505vm-test-run-nixbot-gitlab> gitlab # [  261.284152] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"51e3881820950df15e955340","created_at":"2026-06-29T22:10:04.654Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9072a530e8e1d7b917ec6e9f524ea8e4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.657Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-51e3881820950df15e955340: start","job_status":"start","queue_duration_s":1.150197,"scheduling_latency_s":1.150211}1506vm-test-run-nixbot-gitlab> gitlab # [  261.298239] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.824Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"51e3881820950df15e955340","created_at":"2026-06-29T22:10:04.654Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9072a530e8e1d7b917ec6e9f524ea8e4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.657Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-51e3881820950df15e955340: done: 0.016887 sec","job_status":"done","queue_duration_s":1.150197,"scheduling_latency_s":1.150211,"redis_calls":9,"redis_duration_s":0.002177,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001178,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000999,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00976,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0005123,"exclusive_lock_hold_duration_s":0.00323064,"duration_s":0.016887,"completed_at":"2026-06-29T22:10:05.824Z","load_balancing_strategy":"primary","db_duration_s":0.001569,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507vm-test-run-nixbot-gitlab> gitlab # [  261.338712] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.826Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d964ce525ebdd75a1d3c4021","created_at":"2026-06-29T22:10:04.673Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83f450481f35ebafeae38d5b65ae023f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.677Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d964ce525ebdd75a1d3c4021: start","job_status":"start","queue_duration_s":1.148896,"scheduling_latency_s":1.148911}1508vm-test-run-nixbot-gitlab> gitlab # [  261.353311] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.853Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"d964ce525ebdd75a1d3c4021","created_at":"2026-06-29T22:10:04.673Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"83f450481f35ebafeae38d5b65ae023f","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.677Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-d964ce525ebdd75a1d3c4021: done: 0.02697 sec","job_status":"done","queue_duration_s":1.148896,"scheduling_latency_s":1.148911,"redis_calls":7,"redis_duration_s":0.001501,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001063,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000438,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011428,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.02697,"completed_at":"2026-06-29T22:10:05.852Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.010903,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509vm-test-run-nixbot-gitlab> gitlab # [  261.394932] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.854Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"0a2d5183330bca82964711ff","created_at":"2026-06-29T22:10:04.690Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75e9f365806c0f146f35b4f8eb71d438","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.710Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-0a2d5183330bca82964711ff: start","job_status":"start","queue_duration_s":1.14453,"scheduling_latency_s":1.144547}1510vm-test-run-nixbot-gitlab> gitlab # [  261.408633] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.889Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ContainerRegistry::CleanupWorker","jid":"0a2d5183330bca82964711ff","created_at":"2026-06-29T22:10:04.690Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"75e9f365806c0f146f35b4f8eb71d438","meta.root_caller_id":"Cronjob","meta.feature_category":"container_registry","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:1c3f6896f5901f854330d52bd75eff7c46411059671aef387767811adc368565","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.710Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ContainerRegistry::CleanupWorker JID-0a2d5183330bca82964711ff: done: 0.035351 sec","job_status":"done","queue_duration_s":1.14453,"scheduling_latency_s":1.144547,"redis_calls":10,"redis_duration_s":0.002561,"redis_read_bytes":9,"redis_write_bytes":1071,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000501,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001514,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000546,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018734,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035848,"duration_s":0.035351,"completed_at":"2026-06-29T22:10:05.889Z","load_balancing_strategy":"primary","db_duration_s":0.010108,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511vm-test-run-nixbot-gitlab> gitlab # [  261.450106] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.891Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"2407fd176c586b3f87a4201b","created_at":"2026-06-29T22:10:04.726Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.736Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-2407fd176c586b3f87a4201b: start","job_status":"start","queue_duration_s":1.154863,"scheduling_latency_s":1.154878}1512vm-test-run-nixbot-gitlab> gitlab # [  261.463847] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.980Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"2407fd176c586b3f87a4201b","created_at":"2026-06-29T22:10:04.726Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.736Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-2407fd176c586b3f87a4201b: done: 0.089254 sec","job_status":"done","queue_duration_s":1.154863,"scheduling_latency_s":1.154878,"redis_calls":60,"redis_duration_s":0.015214,"redis_read_bytes":108,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000871,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.01352,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000823,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.075528,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.089254,"completed_at":"2026-06-29T22:10:05.980Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513vm-test-run-nixbot-gitlab> gitlab # [  261.505479] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:05.982Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"cb1c481ff2bcf293e5469f96","created_at":"2026-06-29T22:10:04.764Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b970fd601907f8e08736e4d3c9063913","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.776Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-cb1c481ff2bcf293e5469f96: start","job_status":"start","queue_duration_s":1.205876,"scheduling_latency_s":1.205892}1514vm-test-run-nixbot-gitlab> gitlab # [  261.518649] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.004Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PagesDomainSslRenewalCronWorker","jid":"cb1c481ff2bcf293e5469f96","created_at":"2026-06-29T22:10:04.764Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"b970fd601907f8e08736e4d3c9063913","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:cee20cd61cae5986aa71b6fa6dd981aaba3c2a4e4980220c0e15411712f7b4e3","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.776Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"PagesDomainSslRenewalCronWorker JID-cb1c481ff2bcf293e5469f96: done: 0.022188 sec","job_status":"done","queue_duration_s":1.205876,"scheduling_latency_s":1.205892,"redis_calls":10,"redis_duration_s":0.002489,"redis_read_bytes":9,"redis_write_bytes":1087,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00055,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001443,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":566,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000496,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":216,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014176,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033698,"duration_s":0.022188,"completed_at":"2026-06-29T22:10:06.004Z","load_balancing_strategy":"primary","db_duration_s":0.00075,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515vm-test-run-nixbot-gitlab> gitlab # [  261.559964] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.006Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"78e14b8af24d101513860eaf","created_at":"2026-06-29T22:10:04.802Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"224d89b7abc37463f9963c4bc4bbf5c5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.821Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-78e14b8af24d101513860eaf: start","job_status":"start","queue_duration_s":1.184375,"scheduling_latency_s":1.18439}1516vm-test-run-nixbot-gitlab> gitlab # [  261.574618] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.031Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"78e14b8af24d101513860eaf","created_at":"2026-06-29T22:10:04.802Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"224d89b7abc37463f9963c4bc4bbf5c5","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.821Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-78e14b8af24d101513860eaf: done: 0.025293 sec","job_status":"done","queue_duration_s":1.184375,"scheduling_latency_s":1.18439,"redis_calls":12,"redis_duration_s":0.003183,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000498,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001468,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001217,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00054298,"exclusive_lock_hold_duration_s":0.006062560000000001,"duration_s":0.025293,"completed_at":"2026-06-29T22:10:06.031Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00414,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517vm-test-run-nixbot-gitlab> gitlab # [  261.618860] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"6f1bf694786b3dee031db5af","created_at":"2026-06-29T22:10:04.835Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1bdef90f8f58db323757021ec6d370a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.841Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-6f1bf694786b3dee031db5af: start","job_status":"start","queue_duration_s":1.19157,"scheduling_latency_s":1.191584}1518vm-test-run-nixbot-gitlab> gitlab # [  261.633614] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.040Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1519vm-test-run-nixbot-gitlab> gitlab # [  261.637290] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.045Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"6f1bf694786b3dee031db5af","created_at":"2026-06-29T22:10:04.835Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e1bdef90f8f58db323757021ec6d370a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.841Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-6f1bf694786b3dee031db5af: done: 0.012634 sec","job_status":"done","queue_duration_s":1.19157,"scheduling_latency_s":1.191584,"redis_calls":7,"redis_duration_s":0.00168,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001209,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000471,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012634,"completed_at":"2026-06-29T22:10:06.045Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1520vm-test-run-nixbot-gitlab> gitlab # [  261.678325] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.046Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b2519258218855f357cedb00","created_at":"2026-06-29T22:10:04.846Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0aee60be4172f395706a09feacdd4280","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.850Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b2519258218855f357cedb00: start","job_status":"start","queue_duration_s":1.196277,"scheduling_latency_s":1.196291}1521vm-test-run-nixbot-gitlab> gitlab # [  261.719798] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.072Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"b2519258218855f357cedb00","created_at":"2026-06-29T22:10:04.846Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"0aee60be4172f395706a09feacdd4280","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.850Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-b2519258218855f357cedb00: done: 0.026065 sec","job_status":"done","queue_duration_s":1.196277,"scheduling_latency_s":1.196291,"redis_calls":14,"redis_duration_s":0.0036220000000000002,"redis_read_bytes":16,"redis_write_bytes":4026,"redis_queues_calls":2,"redis_queues_duration_s":0.000366,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3015,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002454,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000802,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018092,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.026065,"completed_at":"2026-06-29T22:10:06.072Z","load_balancing_strategy":"primary","db_duration_s":0.001924,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1522vm-test-run-nixbot-gitlab> gitlab # [  261.790520] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.074Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"9674b0318cc3f65fa36c0b93","created_at":"2026-06-29T22:10:04.855Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c335b80bfd1e7d2b9764b7e2af8cf5f","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.870Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-9674b0318cc3f65fa36c0b93: start","job_status":"start","queue_duration_s":1.204138,"scheduling_latency_s":1.204152}1523vm-test-run-nixbot-gitlab> gitlab # [  261.808892] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.110Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Packages::Cleanup::DeleteOrphanedDependenciesWorker","jid":"9674b0318cc3f65fa36c0b93","created_at":"2026-06-29T22:10:04.855Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2c335b80bfd1e7d2b9764b7e2af8cf5f","meta.root_caller_id":"Cronjob","meta.feature_category":"package_registry","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:ae1976bd21c961bb04f5dedb6e2b63c4b50acd9c52a47e7573ade27e3c65ce36","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.870Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Packages::Cleanup::DeleteOrphanedDependenciesWorker JID-9674b0318cc3f65fa36c0b93: done: 0.036656 sec","job_status":"done","queue_duration_s":1.204138,"scheduling_latency_s":1.204152,"redis_calls":13,"redis_duration_s":0.007706,"redis_read_bytes":10,"redis_write_bytes":1343,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000526,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":345,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001489,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":630,"redis_shared_state_calls":5,"redis_shared_state_duration_s":0.005691,"redis_shared_state_read_bytes":4,"redis_shared_state_write_bytes":368,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014749,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032752,"extra.packages_cleanup_delete_orphaned_dependencies_worker.last_processed_packages_dependency_id":0,"extra.packages_cleanup_delete_orphaned_dependencies_worker.deleted_rows_count":0,"duration_s":0.036656,"completed_at":"2026-06-29T22:10:06.110Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009929,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1524vm-test-run-nixbot-gitlab> gitlab # [  261.861294] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.112Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"5ecbd0334094bf2dc7a03c86","created_at":"2026-06-29T22:10:04.883Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c46da9aaee1d0f41df2ea6953f9de9c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.896Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-5ecbd0334094bf2dc7a03c86: start","job_status":"start","queue_duration_s":1.216193,"scheduling_latency_s":1.216208}1525vm-test-run-nixbot-gitlab> gitlab # [  261.905153] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.148Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::TimedOutBuilds::DropTimedOutWorker","jid":"5ecbd0334094bf2dc7a03c86","created_at":"2026-06-29T22:10:04.883Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8c46da9aaee1d0f41df2ea6953f9de9c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:11a5fdbfa1bf52035908acc769acf4caef1368e7f031a24ef8a306464e46866a","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.896Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropTimedOutWorker JID-5ecbd0334094bf2dc7a03c86: done: 0.035349 sec","job_status":"done","queue_duration_s":1.216193,"scheduling_latency_s":1.216208,"redis_calls":20,"redis_duration_s":0.005541,"redis_read_bytes":23,"redis_write_bytes":4315,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002238,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1065,"redis_queues_calls":4,"redis_queues_duration_s":0.000871,"redis_queues_read_bytes":6,"redis_queues_write_bytes":2020,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.001924,"redis_queues_metadata_read_bytes":8,"redis_queues_metadata_write_bytes":1004,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000508,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022511,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00034888,"duration_s":0.035349,"completed_at":"2026-06-29T22:10:06.147Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003347,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1526vm-test-run-nixbot-gitlab> gitlab # [  261.975334] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.149Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1c7acec8cc2c82473bdbcca2","created_at":"2026-06-29T22:10:04.921Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8589e8df3dea24b2e0ecdc3ff69af209","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.924Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1c7acec8cc2c82473bdbcca2: start","job_status":"start","queue_duration_s":1.225001,"scheduling_latency_s":1.225016}1527vm-test-run-nixbot-gitlab> gitlab # [  261.991986] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.198Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"1c7acec8cc2c82473bdbcca2","created_at":"2026-06-29T22:10:04.921Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8589e8df3dea24b2e0ecdc3ff69af209","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.924Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-1c7acec8cc2c82473bdbcca2: done: 0.048656 sec","job_status":"done","queue_duration_s":1.225001,"scheduling_latency_s":1.225016,"redis_calls":9,"redis_duration_s":0.002543,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001283,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00126,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00072068,"exclusive_lock_hold_duration_s":0.02388504,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.048656,"completed_at":"2026-06-29T22:10:06.198Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.024907,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1528vm-test-run-nixbot-gitlab> gitlab # [  262.036532] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.199Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"aba9d25c0ac0b42566e6af90","created_at":"2026-06-29T22:10:04.937Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7280fd0b9bd3198b943500e735d5dbb6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.942Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-aba9d25c0ac0b42566e6af90: start","job_status":"start","queue_duration_s":1.257255,"scheduling_latency_s":1.257271}1529vm-test-run-nixbot-gitlab> gitlab # [  262.051447] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.207Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1530vm-test-run-nixbot-gitlab> gitlab # [  262.055057] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.212Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"aba9d25c0ac0b42566e6af90","created_at":"2026-06-29T22:10:04.937Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7280fd0b9bd3198b943500e735d5dbb6","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.942Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-aba9d25c0ac0b42566e6af90: done: 0.012584 sec","job_status":"done","queue_duration_s":1.257255,"scheduling_latency_s":1.257271,"redis_calls":7,"redis_duration_s":0.001574,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001134,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00044,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00739,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012584,"completed_at":"2026-06-29T22:10:06.212Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531vm-test-run-nixbot-gitlab> gitlab # [  262.096582] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.213Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"157634982aceeffde8aafade","created_at":"2026-06-29T22:10:04.961Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"77281092c42990e0e3fe6a73df195842","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.975Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-157634982aceeffde8aafade: start","job_status":"start","queue_duration_s":1.238735,"scheduling_latency_s":1.238751}1532vm-test-run-nixbot-gitlab> gitlab # [  262.111012] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.221Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1533vm-test-run-nixbot-gitlab> gitlab # [  262.114388] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.226Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"157634982aceeffde8aafade","created_at":"2026-06-29T22:10:04.961Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"77281092c42990e0e3fe6a73df195842","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:04.975Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-157634982aceeffde8aafade: done: 0.012949 sec","job_status":"done","queue_duration_s":1.238735,"scheduling_latency_s":1.238751,"redis_calls":7,"redis_duration_s":0.0016749999999999998,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001218,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000457,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012949,"completed_at":"2026-06-29T22:10:06.226Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1534vm-test-run-nixbot-gitlab> gitlab # [  262.155725] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.228Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"58ecad77c0a26887aa84a83f","created_at":"2026-06-29T22:10:05.014Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95f93e11f91a55fd2d1d9bf693a3d76e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.018Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-58ecad77c0a26887aa84a83f: start","job_status":"start","queue_duration_s":1.209234,"scheduling_latency_s":1.209249}1535vm-test-run-nixbot-gitlab> gitlab # [  262.170572] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.240Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"58ecad77c0a26887aa84a83f","created_at":"2026-06-29T22:10:05.014Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"95f93e11f91a55fd2d1d9bf693a3d76e","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.018Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-58ecad77c0a26887aa84a83f: done: 0.012777 sec","job_status":"done","queue_duration_s":1.209234,"scheduling_latency_s":1.209249,"redis_calls":7,"redis_duration_s":0.0016510000000000001,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001177,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000474,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012777,"completed_at":"2026-06-29T22:10:06.240Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1536vm-test-run-nixbot-gitlab> gitlab # [  262.213253] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.242Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"91670120ad1c4e43a39d716f","created_at":"2026-06-29T22:10:05.050Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a2b2673e9ffe96666be9055798fceac","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.087Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-91670120ad1c4e43a39d716f: start","job_status":"start","queue_duration_s":1.154723,"scheduling_latency_s":1.154739}1537vm-test-run-nixbot-gitlab> gitlab # [  262.227070] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.264Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Projects::InactiveProjectsDeletionCronWorker","jid":"91670120ad1c4e43a39d716f","created_at":"2026-06-29T22:10:05.050Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4a2b2673e9ffe96666be9055798fceac","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:442251d7c2d07bf110c698169f390fde7a2ca5a69ba3f639f0fb0d3b8866112f","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.087Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::InactiveProjectsDeletionCronWorker JID-91670120ad1c4e43a39d716f: done: 0.021978 sec","job_status":"done","queue_duration_s":1.154723,"scheduling_latency_s":1.154739,"redis_calls":10,"redis_duration_s":0.0024000000000000002,"redis_read_bytes":9,"redis_write_bytes":1179,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000452,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001433,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":610,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000515,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":238,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033812,"duration_s":0.021978,"completed_at":"2026-06-29T22:10:06.264Z","load_balancing_strategy":"primary","db_duration_s":0.000631,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1538vm-test-run-nixbot-gitlab> gitlab # [  262.269646] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.265Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"91756ac2c2a6c18af02c50cb","created_at":"2026-06-29T22:10:05.126Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"472a3cbc2b38f5ca40ae48d5cdbc8faf","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.145Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-91756ac2c2a6c18af02c50cb: start","job_status":"start","queue_duration_s":1.120098,"scheduling_latency_s":1.120112}1539vm-test-run-nixbot-gitlab> gitlab # [  262.284506] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.286Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"91756ac2c2a6c18af02c50cb","created_at":"2026-06-29T22:10:05.126Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"472a3cbc2b38f5ca40ae48d5cdbc8faf","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.145Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-91756ac2c2a6c18af02c50cb: done: 0.020683 sec","job_status":"done","queue_duration_s":1.120098,"scheduling_latency_s":1.120112,"redis_calls":10,"redis_duration_s":0.002528,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001535,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01182,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00529852,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.020683,"completed_at":"2026-06-29T22:10:06.286Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003689,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1540vm-test-run-nixbot-gitlab> gitlab # [  262.328057] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"0a85effd37b785ef7cba3e85","created_at":"2026-06-29T22:10:05.190Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a32d82ce984b4cd9dddfb2ca3eee69e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.196Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-0a85effd37b785ef7cba3e85: start","job_status":"start","queue_duration_s":1.091001,"scheduling_latency_s":1.091016}1541vm-test-run-nixbot-gitlab> gitlab # [  262.343135] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.300Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"0a85effd37b785ef7cba3e85","created_at":"2026-06-29T22:10:05.190Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a32d82ce984b4cd9dddfb2ca3eee69e5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.196Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-0a85effd37b785ef7cba3e85: done: 0.012694 sec","job_status":"done","queue_duration_s":1.091001,"scheduling_latency_s":1.091016,"redis_calls":7,"redis_duration_s":0.0015630000000000002,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000437,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0076,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012694,"completed_at":"2026-06-29T22:10:06.300Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1542vm-test-run-nixbot-gitlab> gitlab # [  262.385152] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.301Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"aee3e592feed5fc71aa018a3","created_at":"2026-06-29T22:10:05.225Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2949833b85ff75430cd94f5bec21e4a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-29T22:10:05.235Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-aee3e592feed5fc71aa018a3: start","job_status":"start","queue_duration_s":1.066542,"scheduling_latency_s":1.066556}1543vm-test-run-nixbot-gitlab> gitlab # [  262.398595] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.309Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1544vm-test-run-nixbot-gitlab> gitlab # [  262.403005] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"aee3e592feed5fc71aa018a3","created_at":"2026-06-29T22:10:05.225Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2949833b85ff75430cd94f5bec21e4a1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-06-29T22:10:05.235Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-aee3e592feed5fc71aa018a3: done: 0.012375 sec","job_status":"done","queue_duration_s":1.066542,"scheduling_latency_s":1.066556,"redis_calls":7,"redis_duration_s":0.001694,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001228,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000466,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012375,"completed_at":"2026-06-29T22:10:06.314Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545vm-test-run-nixbot-gitlab> gitlab # [  262.443399] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.315Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"2cc9f212a5c92ef1f1e4f361","created_at":"2026-06-29T22:10:05.260Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43de6aa8284e0dbe6eb9e96ba528aadb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-29T22:10:05.274Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-2cc9f212a5c92ef1f1e4f361: start","job_status":"start","queue_duration_s":1.041502,"scheduling_latency_s":1.041516}1546vm-test-run-nixbot-gitlab> gitlab # [  262.457297] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.322Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1547vm-test-run-nixbot-gitlab> gitlab # [  262.461127] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.328Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"2cc9f212a5c92ef1f1e4f361","created_at":"2026-06-29T22:10:05.260Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"43de6aa8284e0dbe6eb9e96ba528aadb","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-06-29T22:10:05.274Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-2cc9f212a5c92ef1f1e4f361: done: 0.012434 sec","job_status":"done","queue_duration_s":1.041502,"scheduling_latency_s":1.041516,"redis_calls":7,"redis_duration_s":0.001627,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001158,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000469,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.007513,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.012434,"completed_at":"2026-06-29T22:10:06.328Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1548vm-test-run-nixbot-gitlab> gitlab # [  262.500937] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.329Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7b24d7e414324192f9f2d363","created_at":"2026-06-29T22:10:05.296Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"108baed2683b9302b41c687cddb9638d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.310Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7b24d7e414324192f9f2d363: start","job_status":"start","queue_duration_s":1.018983,"scheduling_latency_s":1.018997}1549vm-test-run-nixbot-gitlab> gitlab # [  262.515278] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.599Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"7b24d7e414324192f9f2d363","created_at":"2026-06-29T22:10:05.296Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"108baed2683b9302b41c687cddb9638d","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.310Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-7b24d7e414324192f9f2d363: done: 0.270094 sec","job_status":"done","queue_duration_s":1.018983,"scheduling_latency_s":1.018997,"redis_calls":571,"redis_duration_s":0.05661,"redis_read_bytes":569,"redis_write_bytes":49487,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001029,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":566,"redis_shared_state_duration_s":0.055581,"redis_shared_state_read_bytes":565,"redis_shared_state_write_bytes":49017,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.245551,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.270094,"completed_at":"2026-06-29T22:10:06.599Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1550vm-test-run-nixbot-gitlab> gitlab # [  262.556490] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.601Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"12412d7733a8d09013b9af71","created_at":"2026-06-29T22:10:05.339Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6eb9b33b73dd198ea2cfc84cdad1031","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.356Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-12412d7733a8d09013b9af71: start","job_status":"start","queue_duration_s":1.244629,"scheduling_latency_s":1.244651}1551vm-test-run-nixbot-gitlab> gitlab # [  262.571085] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.688Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"12412d7733a8d09013b9af71","created_at":"2026-06-29T22:10:05.339Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d6eb9b33b73dd198ea2cfc84cdad1031","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.356Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-12412d7733a8d09013b9af71: done: 0.087758 sec","job_status":"done","queue_duration_s":1.244629,"scheduling_latency_s":1.244651,"redis_calls":9,"redis_duration_s":0.002456,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001208,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001248,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.024,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00048868,"exclusive_lock_hold_duration_s":0.06604964,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.087758,"completed_at":"2026-06-29T22:10:06.688Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.047496,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552vm-test-run-nixbot-gitlab> gitlab # [  262.616119] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.691Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"503586c253e283e88c505597","created_at":"2026-06-29T22:10:05.377Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d63631c1e720be7240683aa5df96558","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.393Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-503586c253e283e88c505597: start","job_status":"start","queue_duration_s":1.29803,"scheduling_latency_s":1.298071}1553vm-test-run-nixbot-gitlab> gitlab # [  262.630007] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.739Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"503586c253e283e88c505597","created_at":"2026-06-29T22:10:05.377Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4d63631c1e720be7240683aa5df96558","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.393Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-503586c253e283e88c505597: done: 0.047937 sec","job_status":"done","queue_duration_s":1.29803,"scheduling_latency_s":1.298071,"redis_calls":7,"redis_duration_s":0.002693,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.0019,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000793,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02027,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.047937,"completed_at":"2026-06-29T22:10:06.739Z","load_balancing_strategy":"primary","db_duration_s":0.016609,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1554vm-test-run-nixbot-gitlab> gitlab # [  262.671593] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.742Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"066742c882e8a191c32f6f58","created_at":"2026-06-29T22:10:05.428Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13be1617e1b9986d9cbb16723de707f8","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.455Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-066742c882e8a191c32f6f58: start","job_status":"start","queue_duration_s":1.286595,"scheduling_latency_s":1.286628}1555vm-test-run-nixbot-gitlab> gitlab # [  262.685366] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.827Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Pages::DeactivateExpiredDeploymentsCronWorker","jid":"066742c882e8a191c32f6f58","created_at":"2026-06-29T22:10:05.428Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-cce45f7536bc442f","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"13be1617e1b9986d9cbb16723de707f8","meta.root_caller_id":"Cronjob","meta.feature_category":"pages","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:787f72254f5c8a3553ab694c3728fa911b46196df537a2b1a46751f692c5ffa6","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.455Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Pages::DeactivateExpiredDeploymentsCronWorker JID-066742c882e8a191c32f6f58: done: 0.084668 sec","job_status":"done","queue_duration_s":1.286595,"scheduling_latency_s":1.286628,"redis_calls":10,"redis_duration_s":0.004001,"redis_read_bytes":9,"redis_write_bytes":1187,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000767,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":333,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002413,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000821,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":240,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.02,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.047981,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00088718,"extra.pages_deactivate_expired_deployments_cron_worker.deactivate_expired_pages_deployments":{"deactivated_deployments":0,"duration":0.0037223},"duration_s":0.084668,"completed_at":"2026-06-29T22:10:06.827Z","load_balancing_strategy":"primary","db_duration_s":0.02268,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1556vm-test-run-nixbot-gitlab> gitlab # [  262.728979] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaf8cd62fc7cbc6ef2689536","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaf8cd62fc7cbc6ef2689536: start","job_status":"start","queue_duration_s":0.856161,"scheduling_latency_s":0.856192}1557vm-test-run-nixbot-gitlab> gitlab # [  262.741518] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.857Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eaf8cd62fc7cbc6ef2689536","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eaf8cd62fc7cbc6ef2689536: done: 0.028065 sec","job_status":"done","queue_duration_s":0.856161,"scheduling_latency_s":0.856192,"redis_calls":13,"redis_duration_s":0.0038469999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001227,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00262,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017942,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.028065,"completed_at":"2026-06-29T22:10:06.857Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558vm-test-run-nixbot-gitlab> gitlab # [  262.781142] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60b923ac6a34b8282b3da1bd","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60b923ac6a34b8282b3da1bd: start","job_status":"start","queue_duration_s":0.886292,"scheduling_latency_s":0.886316}1559vm-test-run-nixbot-gitlab> gitlab # [  262.793802] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.882Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"60b923ac6a34b8282b3da1bd","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-60b923ac6a34b8282b3da1bd: done: 0.022984 sec","job_status":"done","queue_duration_s":0.886292,"scheduling_latency_s":0.886316,"redis_calls":13,"redis_duration_s":0.003424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00116,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002264,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01494,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022984,"completed_at":"2026-06-29T22:10:06.882Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1560vm-test-run-nixbot-gitlab> gitlab # [  262.834437] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.884Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25de1e684b1c226638d3ca34","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25de1e684b1c226638d3ca34: start","job_status":"start","queue_duration_s":0.91102,"scheduling_latency_s":0.91104}1561vm-test-run-nixbot-gitlab> gitlab # [  262.846957] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.903Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"25de1e684b1c226638d3ca34","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-25de1e684b1c226638d3ca34: done: 0.01904 sec","job_status":"done","queue_duration_s":0.91102,"scheduling_latency_s":0.91104,"redis_calls":13,"redis_duration_s":0.003104,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00102,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002084,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011829,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01904,"completed_at":"2026-06-29T22:10:06.903Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1562vm-test-run-nixbot-gitlab> gitlab # [  262.886752] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.905Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"202b0b2696cba55812462244","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-202b0b2696cba55812462244: start","job_status":"start","queue_duration_s":0.931595,"scheduling_latency_s":0.931613}1563vm-test-run-nixbot-gitlab> gitlab # [  262.899571] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.921Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"202b0b2696cba55812462244","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-202b0b2696cba55812462244: done: 0.01616 sec","job_status":"done","queue_duration_s":0.931595,"scheduling_latency_s":0.931613,"redis_calls":13,"redis_duration_s":0.0025900000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00093,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00166,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01616,"completed_at":"2026-06-29T22:10:06.921Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1564vm-test-run-nixbot-gitlab> gitlab # [  262.939340] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.922Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27a790847e3eb8d329a1ed4c","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27a790847e3eb8d329a1ed4c: start","job_status":"start","queue_duration_s":0.949219,"scheduling_latency_s":0.949235}1565vm-test-run-nixbot-gitlab> gitlab # [  262.952189] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.938Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27a790847e3eb8d329a1ed4c","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27a790847e3eb8d329a1ed4c: done: 0.015209 sec","job_status":"done","queue_duration_s":0.949219,"scheduling_latency_s":0.949235,"redis_calls":13,"redis_duration_s":0.002863,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001863,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00925,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015209,"completed_at":"2026-06-29T22:10:06.938Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1566vm-test-run-nixbot-gitlab> gitlab # [  262.991858] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.939Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56786300d7bc6c6a1299d5af","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56786300d7bc6c6a1299d5af: start","job_status":"start","queue_duration_s":0.965763,"scheduling_latency_s":0.965778}1567vm-test-run-nixbot-gitlab> gitlab # [  263.004529] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56786300d7bc6c6a1299d5af","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56786300d7bc6c6a1299d5af: done: 0.014784 sec","job_status":"done","queue_duration_s":0.965763,"scheduling_latency_s":0.965778,"redis_calls":13,"redis_duration_s":0.002617,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00169,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009187,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014784,"completed_at":"2026-06-29T22:10:06.954Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1568vm-test-run-nixbot-gitlab> gitlab # [  263.045180] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.955Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b90e8f4f11dc2c171be4c8b2","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b90e8f4f11dc2c171be4c8b2: start","job_status":"start","queue_duration_s":0.982147,"scheduling_latency_s":0.982163}1569vm-test-run-nixbot-gitlab> gitlab # [  263.057821] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.970Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b90e8f4f11dc2c171be4c8b2","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b90e8f4f11dc2c171be4c8b2: done: 0.015095 sec","job_status":"done","queue_duration_s":0.982147,"scheduling_latency_s":0.982163,"redis_calls":13,"redis_duration_s":0.00266,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001748,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008966,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015095,"completed_at":"2026-06-29T22:10:06.970Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1570vm-test-run-nixbot-gitlab> gitlab # [  263.097318] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.972Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05d78c5c72735a0ea28f8971","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05d78c5c72735a0ea28f8971: start","job_status":"start","queue_duration_s":0.998619,"scheduling_latency_s":0.998634}1571vm-test-run-nixbot-gitlab> gitlab # [  263.110027] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.986Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05d78c5c72735a0ea28f8971","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05d78c5c72735a0ea28f8971: done: 0.014536 sec","job_status":"done","queue_duration_s":0.998619,"scheduling_latency_s":0.998634,"redis_calls":13,"redis_duration_s":0.0025970000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001685,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009026,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014536,"completed_at":"2026-06-29T22:10:06.986Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1572vm-test-run-nixbot-gitlab> gitlab # [  263.149642] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:06.988Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d81d64ff9636dd3a553f106e","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d81d64ff9636dd3a553f106e: start","job_status":"start","queue_duration_s":1.01447,"scheduling_latency_s":1.014485}1573vm-test-run-nixbot-gitlab> gitlab # [  263.162339] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.002Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d81d64ff9636dd3a553f106e","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d81d64ff9636dd3a553f106e: done: 0.014618 sec","job_status":"done","queue_duration_s":1.01447,"scheduling_latency_s":1.014485,"redis_calls":13,"redis_duration_s":0.002659,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001722,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009041,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014618,"completed_at":"2026-06-29T22:10:07.002Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1574vm-test-run-nixbot-gitlab> gitlab # [  263.202058] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"886158ff317a2d60342cd7ea","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-886158ff317a2d60342cd7ea: start","job_status":"start","queue_duration_s":1.030498,"scheduling_latency_s":1.030513}1575vm-test-run-nixbot-gitlab> gitlab # [  263.214467] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"886158ff317a2d60342cd7ea","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-886158ff317a2d60342cd7ea: done: 0.014838 sec","job_status":"done","queue_duration_s":1.030498,"scheduling_latency_s":1.030513,"redis_calls":13,"redis_duration_s":0.002973,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000961,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002012,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014838,"completed_at":"2026-06-29T22:10:07.018Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1576vm-test-run-nixbot-gitlab> gitlab # [  263.255224] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.020Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea53c048cf6dd81d29a887ac","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea53c048cf6dd81d29a887ac: start","job_status":"start","queue_duration_s":1.046845,"scheduling_latency_s":1.046861}1577vm-test-run-nixbot-gitlab> gitlab # [  263.268092] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.035Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ea53c048cf6dd81d29a887ac","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ea53c048cf6dd81d29a887ac: done: 0.014687 sec","job_status":"done","queue_duration_s":1.046845,"scheduling_latency_s":1.046861,"redis_calls":13,"redis_duration_s":0.002869,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001961,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00893,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014687,"completed_at":"2026-06-29T22:10:07.035Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1578vm-test-run-nixbot-gitlab> gitlab # [  263.307629] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.036Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29a04ee60ec4880fd680379f","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29a04ee60ec4880fd680379f: start","job_status":"start","queue_duration_s":1.062846,"scheduling_latency_s":1.062862}1579vm-test-run-nixbot-gitlab> gitlab # [  263.320215] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.051Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29a04ee60ec4880fd680379f","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29a04ee60ec4880fd680379f: done: 0.014531 sec","job_status":"done","queue_duration_s":1.062846,"scheduling_latency_s":1.062862,"redis_calls":13,"redis_duration_s":0.0026620000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001711,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009033,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014531,"completed_at":"2026-06-29T22:10:07.051Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1580vm-test-run-nixbot-gitlab> gitlab # [  263.360894] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8165c5318921789c1c7569b3","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8165c5318921789c1c7569b3: start","job_status":"start","queue_duration_s":1.078871,"scheduling_latency_s":1.078888}1581vm-test-run-nixbot-gitlab> gitlab # [  263.373467] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.068Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8165c5318921789c1c7569b3","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8165c5318921789c1c7569b3: done: 0.015455 sec","job_status":"done","queue_duration_s":1.078871,"scheduling_latency_s":1.078888,"redis_calls":13,"redis_duration_s":0.003241,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001437,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001804,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015455,"completed_at":"2026-06-29T22:10:07.067Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1582vm-test-run-nixbot-gitlab> gitlab # [  263.413487] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.069Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0e6c9aaa2d886975c0ee45d","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0e6c9aaa2d886975c0ee45d: start","job_status":"start","queue_duration_s":1.095716,"scheduling_latency_s":1.095731}1583vm-test-run-nixbot-gitlab> gitlab # [  263.427194] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.084Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0e6c9aaa2d886975c0ee45d","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0e6c9aaa2d886975c0ee45d: done: 0.014592 sec","job_status":"done","queue_duration_s":1.095716,"scheduling_latency_s":1.095731,"redis_calls":13,"redis_duration_s":0.002656,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001736,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014592,"completed_at":"2026-06-29T22:10:07.083Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1584vm-test-run-nixbot-gitlab> gitlab # [  263.467749] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.085Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"972811125d79c93ab98c09bc","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-972811125d79c93ab98c09bc: start","job_status":"start","queue_duration_s":1.111724,"scheduling_latency_s":1.111739}1585vm-test-run-nixbot-gitlab> gitlab # [  263.480660] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.099Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"972811125d79c93ab98c09bc","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-972811125d79c93ab98c09bc: done: 0.014552 sec","job_status":"done","queue_duration_s":1.111724,"scheduling_latency_s":1.111739,"redis_calls":13,"redis_duration_s":0.002639,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000879,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014552,"completed_at":"2026-06-29T22:10:07.099Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1586vm-test-run-nixbot-gitlab> gitlab # [  263.520403] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.101Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7af509bd1d0e84f76a66bd80","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7af509bd1d0e84f76a66bd80: start","job_status":"start","queue_duration_s":1.127614,"scheduling_latency_s":1.127629}1587vm-test-run-nixbot-gitlab> gitlab # [  263.532895] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.128Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7af509bd1d0e84f76a66bd80","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7af509bd1d0e84f76a66bd80: done: 0.02692 sec","job_status":"done","queue_duration_s":1.127614,"scheduling_latency_s":1.127629,"redis_calls":13,"redis_duration_s":0.003718,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001641,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002077,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.02692,"completed_at":"2026-06-29T22:10:07.128Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1588vm-test-run-nixbot-gitlab> gitlab # [  263.572821] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.131Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"135125ff8b36d9825d376550","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-135125ff8b36d9825d376550: start","job_status":"start","queue_duration_s":1.158144,"scheduling_latency_s":1.158185}1589vm-test-run-nixbot-gitlab> gitlab # [  263.585204] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.183Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"135125ff8b36d9825d376550","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-135125ff8b36d9825d376550: done: 0.05218 sec","job_status":"done","queue_duration_s":1.158144,"scheduling_latency_s":1.158185,"redis_calls":13,"redis_duration_s":0.014948,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.003503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.011445,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030841,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.05218,"completed_at":"2026-06-29T22:10:07.183Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1590vm-test-run-nixbot-gitlab> gitlab # [  263.625851] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f7cc4613cdbab76c62d4f5b","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f7cc4613cdbab76c62d4f5b: start","job_status":"start","queue_duration_s":1.213128,"scheduling_latency_s":1.213164}1591vm-test-run-nixbot-gitlab> gitlab # [  263.638565] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1f7cc4613cdbab76c62d4f5b","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1f7cc4613cdbab76c62d4f5b: done: 0.029966 sec","job_status":"done","queue_duration_s":1.213128,"scheduling_latency_s":1.213164,"redis_calls":13,"redis_duration_s":0.004136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001471,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002665,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019316,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.029966,"completed_at":"2026-06-29T22:10:07.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1592vm-test-run-nixbot-gitlab> gitlab # [  263.678351] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.219Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"173a52282bc9103068a0917e","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-173a52282bc9103068a0917e: start","job_status":"start","queue_duration_s":1.245275,"scheduling_latency_s":1.245306}1593vm-test-run-nixbot-gitlab> gitlab # [  263.690940] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.243Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"173a52282bc9103068a0917e","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-173a52282bc9103068a0917e: done: 0.024122 sec","job_status":"done","queue_duration_s":1.245275,"scheduling_latency_s":1.245306,"redis_calls":13,"redis_duration_s":0.003405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001221,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002184,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.024122,"completed_at":"2026-06-29T22:10:07.243Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1594vm-test-run-nixbot-gitlab> gitlab # [  263.731022] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.244Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bcd4262976d1dd618c571d7","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bcd4262976d1dd618c571d7: start","job_status":"start","queue_duration_s":1.271143,"scheduling_latency_s":1.271164}1595vm-test-run-nixbot-gitlab> gitlab # [  263.743689] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2bcd4262976d1dd618c571d7","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2bcd4262976d1dd618c571d7: done: 0.019278 sec","job_status":"done","queue_duration_s":1.271143,"scheduling_latency_s":1.271164,"redis_calls":13,"redis_duration_s":0.0033369999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001459,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012016,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019278,"completed_at":"2026-06-29T22:10:07.264Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1596vm-test-run-nixbot-gitlab> gitlab # [  263.783954] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.265Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"929efc9a19ff313accd97c1e","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-929efc9a19ff313accd97c1e: start","job_status":"start","queue_duration_s":1.291993,"scheduling_latency_s":1.29201}1597vm-test-run-nixbot-gitlab> gitlab # [  263.796919] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"929efc9a19ff313accd97c1e","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-929efc9a19ff313accd97c1e: done: 0.018217 sec","job_status":"done","queue_duration_s":1.291993,"scheduling_latency_s":1.29201,"redis_calls":13,"redis_duration_s":0.003085,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001038,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002047,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0116,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.018217,"completed_at":"2026-06-29T22:10:07.283Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1598vm-test-run-nixbot-gitlab> gitlab # [  263.837678] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69999165090101c3f2206595","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69999165090101c3f2206595: start","job_status":"start","queue_duration_s":1.311771,"scheduling_latency_s":1.311788}1599vm-test-run-nixbot-gitlab> gitlab # [  263.850437] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"69999165090101c3f2206595","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-69999165090101c3f2206595: done: 0.017218 sec","job_status":"done","queue_duration_s":1.311771,"scheduling_latency_s":1.311788,"redis_calls":13,"redis_duration_s":0.002857,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001857,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010948,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017218,"completed_at":"2026-06-29T22:10:07.302Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1600vm-test-run-nixbot-gitlab> gitlab # [  263.890494] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"330a15da6024611ea6908707","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-330a15da6024611ea6908707: start","job_status":"start","queue_duration_s":1.330504,"scheduling_latency_s":1.330521}1601vm-test-run-nixbot-gitlab> gitlab # [  263.903533] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.320Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"330a15da6024611ea6908707","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-330a15da6024611ea6908707: done: 0.015824 sec","job_status":"done","queue_duration_s":1.330504,"scheduling_latency_s":1.330521,"redis_calls":13,"redis_duration_s":0.002807,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00094,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001867,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015824,"completed_at":"2026-06-29T22:10:07.319Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1602vm-test-run-nixbot-gitlab> gitlab # [  263.943653] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.321Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5188cbeeddc53de509dc1ee8","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5188cbeeddc53de509dc1ee8: start","job_status":"start","queue_duration_s":1.347712,"scheduling_latency_s":1.347728}1603vm-test-run-nixbot-gitlab> gitlab # [  263.956525] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.336Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5188cbeeddc53de509dc1ee8","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5188cbeeddc53de509dc1ee8: done: 0.014656 sec","job_status":"done","queue_duration_s":1.347712,"scheduling_latency_s":1.347728,"redis_calls":13,"redis_duration_s":0.002647,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000915,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001732,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008914,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014656,"completed_at":"2026-06-29T22:10:07.336Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1604vm-test-run-nixbot-gitlab> gitlab # [  263.996819] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.337Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05bb4574fdb00f44b26d8fab","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05bb4574fdb00f44b26d8fab: start","job_status":"start","queue_duration_s":1.363726,"scheduling_latency_s":1.36374}1605vm-test-run-nixbot-gitlab> gitlab # [  264.009261] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.351Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05bb4574fdb00f44b26d8fab","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05bb4574fdb00f44b26d8fab: done: 0.014389 sec","job_status":"done","queue_duration_s":1.363726,"scheduling_latency_s":1.36374,"redis_calls":13,"redis_duration_s":0.002614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001715,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008814,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014389,"completed_at":"2026-06-29T22:10:07.351Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1606vm-test-run-nixbot-gitlab> gitlab # [  264.050006] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.353Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9862f4bb099ced1cf2cc6c0d","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9862f4bb099ced1cf2cc6c0d: start","job_status":"start","queue_duration_s":1.379435,"scheduling_latency_s":1.379449}1607vm-test-run-nixbot-gitlab> gitlab # [  264.062739] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.368Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9862f4bb099ced1cf2cc6c0d","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9862f4bb099ced1cf2cc6c0d: done: 0.014933 sec","job_status":"done","queue_duration_s":1.379435,"scheduling_latency_s":1.379449,"redis_calls":13,"redis_duration_s":0.0030659999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002162,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008991,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014933,"completed_at":"2026-06-29T22:10:07.368Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1608vm-test-run-nixbot-gitlab> gitlab # [  264.102673] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.369Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc1b1317f01cbfb670056d6b","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc1b1317f01cbfb670056d6b: start","job_status":"start","queue_duration_s":1.395742,"scheduling_latency_s":1.395757}1609vm-test-run-nixbot-gitlab> gitlab # [  264.115269] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.383Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc1b1317f01cbfb670056d6b","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc1b1317f01cbfb670056d6b: done: 0.014291 sec","job_status":"done","queue_duration_s":1.395742,"scheduling_latency_s":1.395757,"redis_calls":13,"redis_duration_s":0.002551,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001648,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008799,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014291,"completed_at":"2026-06-29T22:10:07.383Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1610vm-test-run-nixbot-gitlab> gitlab # [  264.155195] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5a7118d915f464d94528df2","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5a7118d915f464d94528df2: start","job_status":"start","queue_duration_s":1.411468,"scheduling_latency_s":1.411483}1611vm-test-run-nixbot-gitlab> gitlab # [  264.167989] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.399Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e5a7118d915f464d94528df2","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e5a7118d915f464d94528df2: done: 0.014545 sec","job_status":"done","queue_duration_s":1.411468,"scheduling_latency_s":1.411483,"redis_calls":13,"redis_duration_s":0.0027660000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000918,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001848,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008927,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014545,"completed_at":"2026-06-29T22:10:07.399Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1612vm-test-run-nixbot-gitlab> gitlab # [  264.207784] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.401Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78ec75b8dd743e02256fa522","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78ec75b8dd743e02256fa522: start","job_status":"start","queue_duration_s":1.427675,"scheduling_latency_s":1.427691}1613vm-test-run-nixbot-gitlab> gitlab # [  264.220625] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.416Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"78ec75b8dd743e02256fa522","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-78ec75b8dd743e02256fa522: done: 0.014756 sec","job_status":"done","queue_duration_s":1.427675,"scheduling_latency_s":1.427691,"redis_calls":13,"redis_duration_s":0.002801,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014756,"completed_at":"2026-06-29T22:10:07.416Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1614vm-test-run-nixbot-gitlab> gitlab # [  264.260761] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.417Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a10129665729351ac00542c","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a10129665729351ac00542c: start","job_status":"start","queue_duration_s":1.443753,"scheduling_latency_s":1.443768}1615vm-test-run-nixbot-gitlab> gitlab # [  264.273424] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.431Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2a10129665729351ac00542c","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2a10129665729351ac00542c: done: 0.014225 sec","job_status":"done","queue_duration_s":1.443753,"scheduling_latency_s":1.443768,"redis_calls":13,"redis_duration_s":0.002606,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0009,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001706,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008759,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014225,"completed_at":"2026-06-29T22:10:07.431Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1616vm-test-run-nixbot-gitlab> gitlab # [  264.312897] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.432Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1850c70e8c072e322f9db089","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1850c70e8c072e322f9db089: start","job_status":"start","queue_duration_s":1.45923,"scheduling_latency_s":1.459244}1617vm-test-run-nixbot-gitlab> gitlab # [  264.325432] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.447Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1850c70e8c072e322f9db089","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1850c70e8c072e322f9db089: done: 0.014475 sec","job_status":"done","queue_duration_s":1.45923,"scheduling_latency_s":1.459244,"redis_calls":13,"redis_duration_s":0.00267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001758,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014475,"completed_at":"2026-06-29T22:10:07.447Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1618vm-test-run-nixbot-gitlab> gitlab # [  264.365103] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.448Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05d4f91a51b0227080373869","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05d4f91a51b0227080373869: start","job_status":"start","queue_duration_s":1.475072,"scheduling_latency_s":1.475086}1619vm-test-run-nixbot-gitlab> gitlab # [  264.377884] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.463Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"05d4f91a51b0227080373869","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-05d4f91a51b0227080373869: done: 0.014439 sec","job_status":"done","queue_duration_s":1.475072,"scheduling_latency_s":1.475086,"redis_calls":13,"redis_duration_s":0.00266,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001744,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008949,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014439,"completed_at":"2026-06-29T22:10:07.463Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1620vm-test-run-nixbot-gitlab> gitlab # [  264.417606] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.464Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7010b288427c05b8c312dcda","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7010b288427c05b8c312dcda: start","job_status":"start","queue_duration_s":1.491084,"scheduling_latency_s":1.491099}1621vm-test-run-nixbot-gitlab> gitlab # [  264.430146] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.479Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7010b288427c05b8c312dcda","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7010b288427c05b8c312dcda: done: 0.014316 sec","job_status":"done","queue_duration_s":1.491084,"scheduling_latency_s":1.491099,"redis_calls":13,"redis_duration_s":0.0025960000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001712,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008853,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014316,"completed_at":"2026-06-29T22:10:07.479Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1622vm-test-run-nixbot-gitlab> gitlab # [  264.471325] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54cfedf348d9457d0cf05596","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54cfedf348d9457d0cf05596: start","job_status":"start","queue_duration_s":1.50666,"scheduling_latency_s":1.506675}1623vm-test-run-nixbot-gitlab> gitlab # [  264.484731] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.494Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"54cfedf348d9457d0cf05596","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-54cfedf348d9457d0cf05596: done: 0.014477 sec","job_status":"done","queue_duration_s":1.50666,"scheduling_latency_s":1.506675,"redis_calls":13,"redis_duration_s":0.0027289999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00098,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001749,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014477,"completed_at":"2026-06-29T22:10:07.494Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1624vm-test-run-nixbot-gitlab> gitlab # [  264.525356] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.496Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2ee0d622ded3e8b47fffefa","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2ee0d622ded3e8b47fffefa: start","job_status":"start","queue_duration_s":1.522363,"scheduling_latency_s":1.522378}1625vm-test-run-nixbot-gitlab> gitlab # [  264.538197] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.510Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e2ee0d622ded3e8b47fffefa","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e2ee0d622ded3e8b47fffefa: done: 0.014199 sec","job_status":"done","queue_duration_s":1.522363,"scheduling_latency_s":1.522378,"redis_calls":13,"redis_duration_s":0.002547,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000922,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001625,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014199,"completed_at":"2026-06-29T22:10:07.510Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1626vm-test-run-nixbot-gitlab> gitlab # [  264.578348] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.511Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0d89407bcf1bb151a15d9cb","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0d89407bcf1bb151a15d9cb: start","job_status":"start","queue_duration_s":1.537884,"scheduling_latency_s":1.537899}1627vm-test-run-nixbot-gitlab> gitlab # [  264.591429] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e0d89407bcf1bb151a15d9cb","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e0d89407bcf1bb151a15d9cb: done: 0.020728 sec","job_status":"done","queue_duration_s":1.537884,"scheduling_latency_s":1.537899,"redis_calls":13,"redis_duration_s":0.002715,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001724,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009084,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.020728,"completed_at":"2026-06-29T22:10:07.532Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1628vm-test-run-nixbot-gitlab> gitlab # [  264.631884] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.533Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"278c7634ba02a9aa0fc11f9e","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-278c7634ba02a9aa0fc11f9e: start","job_status":"start","queue_duration_s":1.559964,"scheduling_latency_s":1.559979}1629vm-test-run-nixbot-gitlab> gitlab # [  264.645634] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"278c7634ba02a9aa0fc11f9e","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-278c7634ba02a9aa0fc11f9e: done: 0.014738 sec","job_status":"done","queue_duration_s":1.559964,"scheduling_latency_s":1.559979,"redis_calls":13,"redis_duration_s":0.0027099999999999997,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000941,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001769,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008921,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014738,"completed_at":"2026-06-29T22:10:07.548Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1630vm-test-run-nixbot-gitlab> gitlab # [  264.685796] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faf20f4552476438097a5723","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faf20f4552476438097a5723: start","job_status":"start","queue_duration_s":1.576018,"scheduling_latency_s":1.576032}1631vm-test-run-nixbot-gitlab> gitlab # [  264.698710] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.564Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"faf20f4552476438097a5723","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-faf20f4552476438097a5723: done: 0.014363 sec","job_status":"done","queue_duration_s":1.576018,"scheduling_latency_s":1.576032,"redis_calls":13,"redis_duration_s":0.002568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001669,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00888,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014363,"completed_at":"2026-06-29T22:10:07.564Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1632vm-test-run-nixbot-gitlab> gitlab # [  264.738909] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88df474a548ac759a57a343d","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88df474a548ac759a57a343d: start","job_status":"start","queue_duration_s":1.591661,"scheduling_latency_s":1.591675}1633vm-test-run-nixbot-gitlab> gitlab # [  264.751579] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.579Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"88df474a548ac759a57a343d","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-88df474a548ac759a57a343d: done: 0.014363 sec","job_status":"done","queue_duration_s":1.591661,"scheduling_latency_s":1.591675,"redis_calls":13,"redis_duration_s":0.002692,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0018,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00885,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014363,"completed_at":"2026-06-29T22:10:07.579Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1634vm-test-run-nixbot-gitlab> gitlab # [  264.791922] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.581Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d6509de83485eccfe75fd48","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d6509de83485eccfe75fd48: start","job_status":"start","queue_duration_s":1.607291,"scheduling_latency_s":1.607304}1635vm-test-run-nixbot-gitlab> gitlab # [  264.804700] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d6509de83485eccfe75fd48","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d6509de83485eccfe75fd48: done: 0.01422 sec","job_status":"done","queue_duration_s":1.607291,"scheduling_latency_s":1.607304,"redis_calls":13,"redis_duration_s":0.002583,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000881,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001702,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01422,"completed_at":"2026-06-29T22:10:07.595Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1636vm-test-run-nixbot-gitlab> gitlab # [  264.844852] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.596Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"710ec27188ffb6af5de0195a","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-710ec27188ffb6af5de0195a: start","job_status":"start","queue_duration_s":1.622824,"scheduling_latency_s":1.622839}1637vm-test-run-nixbot-gitlab> gitlab # [  264.858677] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"710ec27188ffb6af5de0195a","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-710ec27188ffb6af5de0195a: done: 0.01456 sec","job_status":"done","queue_duration_s":1.622824,"scheduling_latency_s":1.622839,"redis_calls":13,"redis_duration_s":0.002671,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000903,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001768,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008986,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01456,"completed_at":"2026-06-29T22:10:07.611Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1638vm-test-run-nixbot-gitlab> gitlab # [  264.899114] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.612Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ab68cd97ab4f44ac2b4c605","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ab68cd97ab4f44ac2b4c605: start","job_status":"start","queue_duration_s":1.638682,"scheduling_latency_s":1.638696}1639vm-test-run-nixbot-gitlab> gitlab # [  264.912165] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6ab68cd97ab4f44ac2b4c605","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6ab68cd97ab4f44ac2b4c605: done: 0.014134 sec","job_status":"done","queue_duration_s":1.638682,"scheduling_latency_s":1.638696,"redis_calls":13,"redis_duration_s":0.002554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001676,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008763,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014134,"completed_at":"2026-06-29T22:10:07.626Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1640vm-test-run-nixbot-gitlab> gitlab # [  264.952433] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a50227556e41c192c878a51","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a50227556e41c192c878a51: start","job_status":"start","queue_duration_s":1.654099,"scheduling_latency_s":1.654114}1641vm-test-run-nixbot-gitlab> gitlab # [  264.964959] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6a50227556e41c192c878a51","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6a50227556e41c192c878a51: done: 0.014264 sec","job_status":"done","queue_duration_s":1.654099,"scheduling_latency_s":1.654114,"redis_calls":13,"redis_duration_s":0.00261,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001704,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008823,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014264,"completed_at":"2026-06-29T22:10:07.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1642vm-test-run-nixbot-gitlab> gitlab # [  265.005010] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13ef49a87c1f72d871164515","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13ef49a87c1f72d871164515: start","job_status":"start","queue_duration_s":1.669654,"scheduling_latency_s":1.669668}1643vm-test-run-nixbot-gitlab> gitlab # [  265.017754] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.657Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"13ef49a87c1f72d871164515","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-13ef49a87c1f72d871164515: done: 0.014438 sec","job_status":"done","queue_duration_s":1.669654,"scheduling_latency_s":1.669668,"redis_calls":13,"redis_duration_s":0.002588,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001636,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009022,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014438,"completed_at":"2026-06-29T22:10:07.657Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1644vm-test-run-nixbot-gitlab> gitlab # [  265.058816] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"257c0bcb0ceb1fccbf271707","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-257c0bcb0ceb1fccbf271707: start","job_status":"start","queue_duration_s":1.685375,"scheduling_latency_s":1.685389}1645vm-test-run-nixbot-gitlab> gitlab # [  265.071732] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.674Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"257c0bcb0ceb1fccbf271707","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-257c0bcb0ceb1fccbf271707: done: 0.014923 sec","job_status":"done","queue_duration_s":1.685375,"scheduling_latency_s":1.685389,"redis_calls":13,"redis_duration_s":0.0031219999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002131,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014923,"completed_at":"2026-06-29T22:10:07.673Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1646vm-test-run-nixbot-gitlab> gitlab # [  265.112192] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31fe1e6569e2e3ea4fc2dd0a","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31fe1e6569e2e3ea4fc2dd0a: start","job_status":"start","queue_duration_s":1.701658,"scheduling_latency_s":1.701673}1647vm-test-run-nixbot-gitlab> gitlab # [  265.124641] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.689Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"31fe1e6569e2e3ea4fc2dd0a","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-31fe1e6569e2e3ea4fc2dd0a: done: 0.014207 sec","job_status":"done","queue_duration_s":1.701658,"scheduling_latency_s":1.701673,"redis_calls":13,"redis_duration_s":0.00253,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001618,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008751,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014207,"completed_at":"2026-06-29T22:10:07.689Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1648vm-test-run-nixbot-gitlab> gitlab # [  265.164644] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.690Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"752df706464477996ff12166","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-752df706464477996ff12166: start","job_status":"start","queue_duration_s":1.71715,"scheduling_latency_s":1.717164}1649vm-test-run-nixbot-gitlab> gitlab # [  265.177287] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"752df706464477996ff12166","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-752df706464477996ff12166: done: 0.014465 sec","job_status":"done","queue_duration_s":1.71715,"scheduling_latency_s":1.717164,"redis_calls":13,"redis_duration_s":0.00267,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001764,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008881,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014465,"completed_at":"2026-06-29T22:10:07.705Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1650vm-test-run-nixbot-gitlab> gitlab # [  265.217319] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.706Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f555444a0a062124c116647e","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f555444a0a062124c116647e: start","job_status":"start","queue_duration_s":1.733005,"scheduling_latency_s":1.73302}1651vm-test-run-nixbot-gitlab> gitlab # [  265.230162] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f555444a0a062124c116647e","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f555444a0a062124c116647e: done: 0.014813 sec","job_status":"done","queue_duration_s":1.733005,"scheduling_latency_s":1.73302,"redis_calls":13,"redis_duration_s":0.002794,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008911,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014813,"completed_at":"2026-06-29T22:10:07.721Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1652vm-test-run-nixbot-gitlab> gitlab # [  265.270835] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.722Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12b78ce587113a47f250bd55","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12b78ce587113a47f250bd55: start","job_status":"start","queue_duration_s":1.749125,"scheduling_latency_s":1.749139}1653vm-test-run-nixbot-gitlab> gitlab # [  265.283764] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.737Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"12b78ce587113a47f250bd55","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-12b78ce587113a47f250bd55: done: 0.014295 sec","job_status":"done","queue_duration_s":1.749125,"scheduling_latency_s":1.749139,"redis_calls":13,"redis_duration_s":0.002574,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000927,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001647,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008846,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014295,"completed_at":"2026-06-29T22:10:07.737Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1654vm-test-run-nixbot-gitlab> gitlab # [  265.324052] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.738Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51b0c009d1fb69e21243b147","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51b0c009d1fb69e21243b147: start","job_status":"start","queue_duration_s":1.76481,"scheduling_latency_s":1.764825}1655vm-test-run-nixbot-gitlab> gitlab # [  265.336590] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.752Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"51b0c009d1fb69e21243b147","created_at":"2026-06-29T22:10:05.900Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-67fbe305e60c44ae","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"9c108cd590819d805f3198394ca82c97","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:05.973Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-51b0c009d1fb69e21243b147: done: 0.014255 sec","job_status":"done","queue_duration_s":1.76481,"scheduling_latency_s":1.764825,"redis_calls":13,"redis_duration_s":0.002447,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000902,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001545,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008855,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014255,"completed_at":"2026-06-29T22:10:07.752Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1656vm-test-run-nixbot-gitlab> gitlab # [  265.376808] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.754Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"239d2eabfb69677438414f34","created_at":"2026-06-29T22:10:06.057Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-f128ce0ce9a54f94","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0aee60be4172f395706a09feacdd4280","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:06.067Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-239d2eabfb69677438414f34: start","job_status":"start","queue_duration_s":1.686657,"scheduling_latency_s":1.686672}1657vm-test-run-nixbot-gitlab> gitlab # [  265.389518] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.765Z","message":"No existing merge request to be cleaned up."}1658vm-test-run-nixbot-gitlab> gitlab # [  265.391251] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.773Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"239d2eabfb69677438414f34","created_at":"2026-06-29T22:10:06.057Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-f128ce0ce9a54f94","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0aee60be4172f395706a09feacdd4280","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:06.067Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-239d2eabfb69677438414f34: done: 0.019793 sec","job_status":"done","queue_duration_s":1.686657,"scheduling_latency_s":1.686672,"redis_calls":10,"redis_duration_s":0.002436,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001033,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001403,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019793,"completed_at":"2026-06-29T22:10:07.773Z","load_balancing_strategy":"primary","db_duration_s":0.003274,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1659vm-test-run-nixbot-gitlab> gitlab # [  265.430730] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.775Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"990e18848e8d13ab9cf6766a","created_at":"2026-06-29T22:10:06.057Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-f128ce0ce9a54f94","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0aee60be4172f395706a09feacdd4280","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:06.067Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-990e18848e8d13ab9cf6766a: start","job_status":"start","queue_duration_s":1.707957,"scheduling_latency_s":1.707971}1660vm-test-run-nixbot-gitlab> gitlab # [  265.443731] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.787Z","message":"No existing merge request to be cleaned up."}1661vm-test-run-nixbot-gitlab> gitlab # [  265.445566] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.795Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"990e18848e8d13ab9cf6766a","created_at":"2026-06-29T22:10:06.057Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-f128ce0ce9a54f94","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0aee60be4172f395706a09feacdd4280","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:06.067Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-990e18848e8d13ab9cf6766a: done: 0.020177 sec","job_status":"done","queue_duration_s":1.707957,"scheduling_latency_s":1.707971,"redis_calls":10,"redis_duration_s":0.002602,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001031,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001571,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020177,"completed_at":"2026-06-29T22:10:07.795Z","load_balancing_strategy":"primary","db_duration_s":0.004036,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1662vm-test-run-nixbot-gitlab> gitlab # [  265.485512] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.797Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"edcdfdd8167378285931a1db","created_at":"2026-06-29T22:10:06.057Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-f128ce0ce9a54f94","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0aee60be4172f395706a09feacdd4280","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:06.067Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-edcdfdd8167378285931a1db: start","job_status":"start","queue_duration_s":1.729574,"scheduling_latency_s":1.729588}1663vm-test-run-nixbot-gitlab> gitlab # [  265.497785] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.807Z","message":"No existing merge request to be cleaned up."}1664vm-test-run-nixbot-gitlab> gitlab # [  265.499455] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.815Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"edcdfdd8167378285931a1db","created_at":"2026-06-29T22:10:06.057Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-f128ce0ce9a54f94","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0aee60be4172f395706a09feacdd4280","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:06.067Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-edcdfdd8167378285931a1db: done: 0.018328 sec","job_status":"done","queue_duration_s":1.729574,"scheduling_latency_s":1.729588,"redis_calls":10,"redis_duration_s":0.002509,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001035,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001474,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011326,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018328,"completed_at":"2026-06-29T22:10:07.815Z","load_balancing_strategy":"primary","db_duration_s":0.002493,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1665vm-test-run-nixbot-gitlab> gitlab # [  265.538582] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.816Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0a86d7863f095658bf58066b","created_at":"2026-06-29T22:10:06.057Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-f128ce0ce9a54f94","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0aee60be4172f395706a09feacdd4280","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:06.067Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0a86d7863f095658bf58066b: start","job_status":"start","queue_duration_s":1.749271,"scheduling_latency_s":1.749286}1666vm-test-run-nixbot-gitlab> gitlab # [  265.551236] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.826Z","message":"No existing merge request to be cleaned up."}1667vm-test-run-nixbot-gitlab> gitlab # [  265.553010] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.834Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"0a86d7863f095658bf58066b","created_at":"2026-06-29T22:10:06.057Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-f128ce0ce9a54f94","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"0aee60be4172f395706a09feacdd4280","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:06.067Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-0a86d7863f095658bf58066b: done: 0.018131 sec","job_status":"done","queue_duration_s":1.749271,"scheduling_latency_s":1.749286,"redis_calls":10,"redis_duration_s":0.002474,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001065,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001409,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011261,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018131,"completed_at":"2026-06-29T22:10:07.834Z","load_balancing_strategy":"primary","db_duration_s":0.00241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1668vm-test-run-nixbot-gitlab> gitlab # [  265.592042] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.836Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"1657110f7896538dfd379235","created_at":"2026-06-29T22:10:06.126Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-0a6c773acf8741a2","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"8c46da9aaee1d0f41df2ea6953f9de9c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:06.134Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-1657110f7896538dfd379235: start","job_status":"start","queue_duration_s":1.701467,"scheduling_latency_s":1.701482}1669vm-test-run-nixbot-gitlab> gitlab # [  265.607133] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.945Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropRunningWorker","jid":"1657110f7896538dfd379235","created_at":"2026-06-29T22:10:06.126Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-0a6c773acf8741a2","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"8c46da9aaee1d0f41df2ea6953f9de9c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c1f34cecaf7af64c199dc18ea8fa612209c900930a454f797bf95dbf199c209c","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:06.134Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropRunningWorker JID-1657110f7896538dfd379235: done: 0.108844 sec","job_status":"done","queue_duration_s":1.701467,"scheduling_latency_s":1.701482,"redis_calls":10,"redis_duration_s":0.002059,"redis_read_bytes":9,"redis_write_bytes":1117,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000445,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":317,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001203,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000411,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":222,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.035,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.035,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022644,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00038288,"duration_s":0.108844,"completed_at":"2026-06-29T22:10:07.945Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.040667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1670vm-test-run-nixbot-gitlab> gitlab # [  265.650869] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.946Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"d22da7d8e134f1534031083d","created_at":"2026-06-29T22:10:06.135Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-0a6c773acf8741a2","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"8c46da9aaee1d0f41df2ea6953f9de9c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:06.140Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-d22da7d8e134f1534031083d: start","job_status":"start","queue_duration_s":1.806067,"scheduling_latency_s":1.80609}1671vm-test-run-nixbot-gitlab> gitlab # [  265.667153] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:07.974Z","retry":1,"queue":"default","version":0,"store":null,"queue_namespace":"timed_out_builds","dead":false,"args":[],"class":"Ci::TimedOutBuilds::DropCancelingWorker","jid":"d22da7d8e134f1534031083d","created_at":"2026-06-29T22:10:06.135Z","trace_propagation_headers":{"sentry-trace":"8e36775e62c24293b228bad8a3bab97c-0a6c773acf8741a2","baggage":"sentry-trace_id=8e36775e62c24293b228bad8a3bab97c,sentry-release=Unknown"},"meta.caller_id":"Ci::TimedOutBuilds::DropTimedOutWorker","correlation_id":"8c46da9aaee1d0f41df2ea6953f9de9c","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:23125b5131e5285ca63ba8858fc6fb370306fe43f055d056b2a837c90773932d","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:06.140Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TimedOutBuilds::DropCancelingWorker JID-d22da7d8e134f1534031083d: done: 0.027796 sec","job_status":"done","queue_duration_s":1.806067,"scheduling_latency_s":1.80609,"redis_calls":10,"redis_duration_s":0.001797,"redis_read_bytes":9,"redis_write_bytes":1133,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000357,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":321,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001073,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":586,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000367,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":226,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01699,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031712,"duration_s":0.027796,"completed_at":"2026-06-29T22:10:07.974Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002549,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1672vm-test-run-nixbot-gitlab> gitlab # [  298.254476] runuser[3310]: pam_unix(runuser:session): session closed for user gitlab1673vm-test-run-nixbot-gitlab> gitlab # [  298.259040] setup-gitlab-start[3652]: +++ date -d '+7 days' +%F1674vm-test-run-nixbot-gitlab> gitlab # [  298.262744] setup-gitlab-start[3651]: ++ jq -r .token1675vm-test-run-nixbot-gitlab> gitlab # [  298.265891] setup-gitlab-start[3650]: ++ curl -fs -X POST -H 'Authorization: Bearer dd66e1567f22139cf7a8adb3ebbf4353c5a9a744f6458880686fe8b67bfea1af' -H 'Content-Type: application/json' -d '{"name":"nixbot","scopes":["api"],"expires_at":"2026-07-06"}' http://gitlab/api/v4/users/1/personal_access_tokens1676vm-test-run-nixbot-gitlab> gitlab # [  298.543284] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:45.408Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"e1a31f27ccdf5a04ce469227","created_at":"2026-06-29T22:10:45.377Z","trace_propagation_headers":{"sentry-trace":"1e12a043d41749b98a694e4fd1d185b2-edd74ec6b3904a8a","baggage":"sentry-trace_id=1e12a043d41749b98a694e4fd1d185b2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYMS0Q4V46Z6T2QYZWR8B","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:067b17034a67727505db9471312be8cca4c2db43a0e8300c2f9bd1fb8877b5e7","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:45.404Z","job_size_bytes":451,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-e1a31f27ccdf5a04ce469227: start","job_status":"start","queue_duration_s":0.003673,"scheduling_latency_s":0.003737}1677vm-test-run-nixbot-gitlab> gitlab # [  298.593454] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:45 +0000] "POST /api/v4/users/1/personal_access_tokens HTTP/1.1" 201 267 "" "curl/8.20.0" 2631678vm-test-run-nixbot-gitlab> gitlab # [  298.599075] setup-gitlab-start[3268]: + TOKEN=glpat-tArzOoBU79Xcu9gJp5oAoW86MQp1OjEH.01.0w0x1ovkm1679vm-test-run-nixbot-gitlab> gitlab # [  298.601849] setup-gitlab-start[3268]: + test -n glpat-tArzOoBU79Xcu9gJp5oAoW86MQp1OjEH.01.0w0x1ovkm1680vm-test-run-nixbot-gitlab> gitlab # [  298.604627] setup-gitlab-start[3268]: + test glpat-tArzOoBU79Xcu9gJp5oAoW86MQp1OjEH.01.0w0x1ovkm '!=' null1681vm-test-run-nixbot-gitlab> gitlab # [  298.607196] setup-gitlab-start[3268]: + mkdir -p /var/lib/secrets1682vm-test-run-nixbot-gitlab> gitlab # [  298.608937] setup-gitlab-start[3268]: + echo glpat-tArzOoBU79Xcu9gJp5oAoW86MQp1OjEH.01.0w0x1ovkm1683vm-test-run-nixbot-gitlab> gitlab # [  298.611166] setup-gitlab-start[3268]: + chmod 644 /var/lib/secrets/gitlab-token1684vm-test-run-nixbot-gitlab> gitlab # [  298.613091] setup-gitlab-start[3268]: + curl -fs -X POST -H 'PRIVATE-TOKEN: glpat-tArzOoBU79Xcu9gJp5oAoW86MQp1OjEH.01.0w0x1ovkm' -H 'Content-Type: application/json' -d '{"name":"test-flake","visibility":"public","topics":["build-with-buildbot"]}' http://gitlab/api/v4/projects1685vm-test-run-nixbot-gitlab> gitlab # [  298.740461] sidekiq-cluster[2440]: {"severity":"WARN","time":"2026-06-29T22:10:45.605Z","retry":3,"queue":"mailers","store":null,"args":["[FILTERED]"],"class":"ActionMailer::MailDeliveryJob","jid":"e1a31f27ccdf5a04ce469227","created_at":"2026-06-29T22:10:45.377Z","trace_propagation_headers":{"sentry-trace":"1e12a043d41749b98a694e4fd1d185b2-edd74ec6b3904a8a","baggage":"sentry-trace_id=1e12a043d41749b98a694e4fd1d185b2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYMS0Q4V46Z6T2QYZWR8B","meta.caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"system_access","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/users/:user_id/personal_access_tokens","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:mailers:067b17034a67727505db9471312be8cca4c2db43a0e8300c2f9bd1fb8877b5e7","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:45.404Z","job_size_bytes":451,"pid":2440,"sidekiq_tid":"lymo","sidekiq_thread_name":"sidekiq.default/processor","message":"ActionMailer::MailDeliveryJob JID-e1a31f27ccdf5a04ce469227: fail: 0.195747 sec","job_status":"fail","queue_duration_s":0.003673,"scheduling_latency_s":0.003737,"redis_calls":17,"redis_duration_s":0.006556,"redis_read_bytes":651,"redis_write_bytes":1842,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.003089,"redis_feature_flag_read_bytes":644,"redis_feature_flag_write_bytes":958,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00252,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.028,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.12294,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00114766,"duration_s":0.195747,"completed_at":"2026-06-29T22:10:45.603Z","load_balancing_strategy":"primary_no_wal","exception.class":"ArgumentError","exception.message":":arguments expected to be an Array of individual string args","exception.backtrace":["/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/network/delivery_methods/sendmail.rb:53:in `initialize'","/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `new'","/nix/store/anil03slywxmk4rnhn17xdngk0v51799-ruby3.3-mail-2.9.0/lib/ruby/gems/3.3.0/gems/mail-2.9.0/lib/mail/message.rb:278:in `delivery_method'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:66:in `wrap_delivery_behavior'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/delivery_methods.rb:80:in `wrap_delivery_behavior!'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:876:in `mail'","app/mailers/application_mailer.rb:85:in `block in mail_with_locale'","lib/gitlab/i18n.rb:116:in `with_locale'","app/mailers/application_mailer.rb:84:in `mail_with_locale'","app/mailers/notify.rb:293:in `email_with_layout'","app/mailers/emails/profile.rb:99:in `access_token_created_email'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:215:in `process_action'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:261:in `block in process_action'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","lib/gitlab/i18n.rb:116:in `with_locale'","lib/gitlab/i18n.rb:126:in `with_default_locale'","app/mailers/application_mailer.rb:60:in `render_with_default_locale'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/callbacks.rb:260:in `process_action'","/nix/store/rwla413y2rjqwmj6fahb1jjs3246g6h0-ruby3.3-actionpack-7.2.3/lib/ruby/gems/3.3.0/gems/actionpack-7.2.3/lib/abstract_controller/base.rb:152:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:29:in `block in process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:21:in `handle_exceptions'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/rescuable.rb:28:in `process'","/nix/store/w9mp1gyfs2qdv12r0ji70idzndmxwz2s-ruby3.3-actionview-7.2.3/lib/ruby/gems/3.3.0/gems/actionview-7.2.3/lib/action_view/rendering.rb:40:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:652:in `block in process'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/base.rb:651:in `process'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:136:in `block in processed_mailer'","\u003cinternal:kernel\u003e:90:in `tap'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:135:in `processed_mailer'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/message_delivery.rb:124:in `deliver_now'","/nix/store/r9cfijmkxqn74a9y8n4fmcwypmha7bka-ruby3.3-actionmailer-7.2.3/lib/ruby/gems/3.3.0/gems/actionmailer-7.2.3/lib/action_mailer/mail_delivery_job.rb:28:in `perform'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:68:in `block in _perform_job'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/qr8jwlszzf80b9yy5410msfvxfhdlv3q-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/railtie.rb:32:in `block (2 levels) in insert_into_active_job'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/p8ylyr0sj9sxcknqcpja13nypqixk2dp-ruby3.3-i18n-1.14.7/lib/ruby/gems/3.3.0/gems/i18n-1.14.7/lib/i18n.rb:353:in `with_locale'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/translation.rb:9:in `block (2 levels) in \u003cmodule:Translation\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/core_ext/time/zones.rb:65:in `use_zone'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/timezones.rb:9:in `block (2 levels) in \u003cmodule:Timezones\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:67:in `_perform_job'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:32:in `_perform_job'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:51:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `block in perform_now'","/nix/store/dmv1shq667w4j882d6hfknpqjgmsjk3d-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:13:in `block in instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:40:in `block in instrument'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/notifications.rb:212:in `instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:39:in `instrument'","/nix/store/dmv1shq667w4j882d6hfknpqjgmsjk3d-ruby3.3-activerecord-7.2.3/lib/ruby/gems/3.3.0/gems/activerecord-7.2.3/lib/active_record/railties/job_runtime.rb:11:in `instrument'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/instrumentation.rb:26:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `block in perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:41:in `tag_logger'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/logging.rb:32:in `perform_now'","/nix/store/dndr7b4a17339dsm67vzb6nv4p2kp82q-ruby3.3-sentry-rails-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-rails-5.23.0/lib/sentry/rails/active_job.rb:8:in `perform_now'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:29:in `block in execute'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:121:in `block in run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:79:in `block (4 levels) in \u003cclass:Railtie\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:87:in `wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/railtie.rb:78:in `block (3 levels) in \u003cclass:Railtie\u003e'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `instance_exec'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:130:in `block in run_callbacks'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/callbacks.rb:141:in `run_callbacks'","/nix/store/8bxd3x89628dxvamnlkr67i03nyww454-ruby3.3-activejob-7.2.3/lib/ruby/gems/3.3.0/gems/activejob-7.2.3/lib/active_job/execution.rb:27:in `execute'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:13:in `perform'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:220:in `execute_job'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:185:in `block (4 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/current_organization/server.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/identity/restore.rb:12:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/resource_usage_limit/middleware.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/resource_usage_limit/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/database/load_balancing/sidekiq_server_middleware.rb:35:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/skip_jobs.rb:51:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/throttling/middleware.rb:18:in `perform'","lib/gitlab/sidekiq_middleware/throttling/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/pause_control/strategies/base.rb:31:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/strategy_handler.rb:22:in `perform'","lib/gitlab/sidekiq_middleware/pause_control/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/duplicate_jobs/strategies/until_executing.rb:16:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/duplicate_job.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/duplicate_jobs/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/concurrency_limit/middleware.rb:44:in `perform'","lib/gitlab/sidekiq_middleware/concurrency_limit/server.rb:8:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/click_house/migration_support/sidekiq_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/worker_context.rb:9:in `wrap_in_optional_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:19:in `block in call'","lib/gitlab/application_context.rb:185:in `block in use'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","lib/gitlab/application_context.rb:185:in `use'","lib/gitlab/application_context.rb:105:in `with_context'","lib/gitlab/sidekiq_middleware/worker_context/server.rb:17:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_status/server_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_versioning/middleware.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `block in call'","lib/gitlab/database/query_analyzer.rb:94:in `within'","lib/gitlab/sidekiq_middleware/query_analyzer.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/admin_mode/server.rb:14:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/set_ip_address.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/instrumentation_logger.rb:10:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/batch_loader.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/extra_done_log_metadata.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/server_metrics.rb:112:in `block in call'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `block in instrument'","lib/gitlab/metrics/background_transaction.rb:33:in `run'","lib/gitlab/sidekiq_middleware/server_metrics.rb:141:in `instrument'","lib/gitlab/sidekiq_middleware/server_metrics.rb:111:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:8:in `block in call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:66:in `enabling_request_store'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/gems/gitlab-safe_request_store/lib/gitlab/safe_request_store.rb:59:in `ensure_request_store'","lib/gitlab/sidekiq_middleware/request_store_middleware.rb:7:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:22:in `block in call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:180:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/user_experience_sli/server.rb:16:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:16:in `block in call'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/context.rb:43:in `with_context'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/context/server.rb:15:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/hci32c03dmcimq95f7j6mhr8r3jxmcw2-ruby3.3-gitlab-labkit-1.5.1/lib/ruby/gems/3.3.0/gems/gitlab-labkit-1.5.1/lib/labkit/middleware/sidekiq/server.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/monitor.rb:10:in `block in call'","lib/gitlab/sidekiq_daemon/monitor.rb:46:in `within_job'","lib/gitlab/sidekiq_middleware/monitor.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:10:in `block in call'","lib/gitlab/sidekiq_sharding/validator.rb:42:in `enabled'","lib/gitlab/sidekiq_middleware/shard_awareness_validator.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","lib/gitlab/sidekiq_middleware/size_limiter/server.rb:13:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/qr8jwlszzf80b9yy5410msfvxfhdlv3q-ruby3.3-marginalia-1.11.1/lib/ruby/gems/3.3.0/gems/marginalia-1.11.1/lib/marginalia/sidekiq_instrumentation.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/zx6ndpscxs64hnidz69ab430ccms6rak-ruby3.3-sentry-sidekiq-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-sidekiq-5.23.0/lib/sentry/sidekiq/sentry_context_middleware.rb:54:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job/interrupt_handler.rb:9:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:183:in `block in traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:26:in `track'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/metrics/tracking.rb:134:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:182:in `traverse'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/middleware/chain.rb:173:in `invoke'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:184:in `block (3 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:145:in `block (6 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:118:in `local'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:144:in `block (5 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:27:in `block in call'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:77:in `block in wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/execution_wrapper.rb:91:in `wrap'","/nix/store/cf9hps81b6xv5b1r3vmw17kgnjg02fib-ruby3.3-activesupport-7.2.3/lib/ruby/gems/3.3.0/gems/activesupport-7.2.3/lib/active_support/reloader.rb:74:in `wrap'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/rails.rb:26:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:139:in `block (4 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:281:in `stats'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:134:in `block (3 levels) in dispatch'","lib/gitlab/sidekiq_logging/structured_logger.rb:21:in `call'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:133:in `block (2 levels) in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_retry.rb:85:in `global'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:132:in `block in dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/job_logger.rb:40:in `prepare'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:131:in `dispatch'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:183:in `block (2 levels) in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `handle_interrupt'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:182:in `block in process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `handle_interrupt'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:181:in `process'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:86:in `process_one'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/processor.rb:76:in `run'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:10:in `watchdog'","/nix/store/q50z9k7w21nl4781zv782gv6pin0gj9b-gemfile-and-lockfile/vendor/gems/sidekiq/lib/sidekiq/component.rb:19:in `block in safe_thread'"],"db_duration_s":0.040343,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1686vm-test-run-nixbot-gitlab> gitlab # [  299.477055] gitaly[1367]: time="2026-06-29T22:10:46.343Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-29T22:10:56.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.343" pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1687vm-test-run-nixbot-gitlab> gitlab # [  299.508365] gitaly[1367]: time="2026-06-29T22:10:46.343Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-29T22:10:56.002" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.343" grpc.time_ms=0.729 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1688vm-test-run-nixbot-gitlab> gitlab # [  299.895014] gitaly[1367]: time="2026-06-29T22:10:46.762Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-29T22:10:56.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.762" pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1689vm-test-run-nixbot-gitlab> gitlab # [  299.927680] gitaly[1367]: time="2026-06-29T22:10:46.762Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-29T22:10:56.001" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.762" grpc.time_ms=0.563 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1690vm-test-run-nixbot-gitlab> gitlab # [  299.963014] gitaly[1367]: time="2026-06-29T22:10:46.808Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF diskcache=3b098441-4e04-4bca-91c7-b130cbcc7d59 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-29T22:10:56.014" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.775" pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1691vm-test-run-nixbot-gitlab> gitlab # [  299.988636] gitaly[1367]: time="2026-06-29T22:10:46.809Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=300 command.oublock=32 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-29T22:10:56.014" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.775" grpc.time_ms=33.793 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1692vm-test-run-nixbot-gitlab> gitlab # [  300.014552] gitaly[1367]: time="2026-06-29T22:10:46.832Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-29T22:10:56.070" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.830" pid=1367 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1693vm-test-run-nixbot-gitlab> gitlab # [  300.033091] gitaly[1367]: time="2026-06-29T22:10:46.832Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-29T22:10:56.070" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.830" grpc.time_ms=1.443 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1694vm-test-run-nixbot-gitlab> gitlab # [  300.050247] gitaly[1367]: time="2026-06-29T22:10:46.858Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-29T22:10:56.080" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.840" grpc.time_ms=17.541 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1695vm-test-run-nixbot-gitlab> gitlab # [  300.070481] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:46.915Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"1b7d86e60509a7f19a658dfb","created_at":"2026-06-29T22:10:46.877Z","trace_propagation_headers":{"sentry-trace":"908cde3376f64fa89aa48dd63479215f-db4aff8814ce44e0","baggage":"sentry-trace_id=908cde3376f64fa89aa48dd63479215f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYN2GY1HGEBYBNKB0Q3WF","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:46.897Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-1b7d86e60509a7f19a658dfb: start","job_status":"start","queue_duration_s":0.018012,"scheduling_latency_s":0.018069}1696vm-test-run-nixbot-gitlab> gitlab # [  300.088383] gitaly[1367]: time="2026-06-29T22:10:46.938Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-29T22:10:56.176" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.937" pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1697vm-test-run-nixbot-gitlab> gitlab # [  300.101646] gitaly[1367]: time="2026-06-29T22:10:46.938Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-29T22:10:56.176" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.937" grpc.time_ms=0.855 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1698vm-test-run-nixbot-gitlab> gitlab # [  300.115130] gitaly[1367]: time="2026-06-29T22:10:46.974Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF diskcache=44fe6e1d-3adb-4e2b-849a-81470d830eff grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-29T22:10:56.182" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.942" pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1699vm-test-run-nixbot-gitlab> gitlab # [  300.127377] gitaly[1367]: time="2026-06-29T22:10:46.974Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=299 command.oublock=32 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-06-29T22:10:56.182" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.942" grpc.time_ms=31.925 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1700vm-test-run-nixbot-gitlab> gitlab # [  300.142143] gitaly[1367]: time="2026-06-29T22:10:46.984Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-29T22:10:56.222" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.983" pid=1367 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1701vm-test-run-nixbot-gitlab> gitlab # [  300.153329] gitaly[1367]: time="2026-06-29T22:10:46.984Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-29T22:10:56.222" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.983" grpc.time_ms=1.317 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1702vm-test-run-nixbot-gitlab> gitlab # [  300.164596] gitaly[1367]: time="2026-06-29T22:10:47.007Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=4 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-29T22:10:56.230" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:46.991" grpc.time_ms=15.835 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1703vm-test-run-nixbot-gitlab> gitlab # [  300.179798] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:47.045Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"1b7d86e60509a7f19a658dfb","created_at":"2026-06-29T22:10:46.877Z","trace_propagation_headers":{"sentry-trace":"908cde3376f64fa89aa48dd63479215f-db4aff8814ce44e0","baggage":"sentry-trace_id=908cde3376f64fa89aa48dd63479215f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYN2GY1HGEBYBNKB0Q3WF","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:46.897Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-1b7d86e60509a7f19a658dfb: done: 0.130605 sec","job_status":"done","queue_duration_s":0.018012,"scheduling_latency_s":0.018069,"redis_calls":15,"redis_duration_s":0.008202000000000001,"redis_read_bytes":140,"redis_write_bytes":1876,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.002176,"redis_feature_flag_read_bytes":132,"redis_feature_flag_write_bytes":711,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.004202,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":606,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001824,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":559,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.015,"db_ci_duration_s":0.006,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.091827,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.06850644,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.130605,"completed_at":"2026-06-29T22:10:47.045Z","load_balancing_strategy":"primary","db_duration_s":0.020763,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1704vm-test-run-nixbot-gitlab> gitlab # [  300.226278] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:47.051Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"07c6f81d70ac3ac5a795f083","created_at":"2026-06-29T22:10:46.913Z","trace_propagation_headers":{"sentry-trace":"908cde3376f64fa89aa48dd63479215f-db4aff8814ce44e0","baggage":"sentry-trace_id=908cde3376f64fa89aa48dd63479215f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYN2GY1HGEBYBNKB0Q3WF","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:46.929Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-07c6f81d70ac3ac5a795f083: start","job_status":"start","queue_duration_s":0.121783,"scheduling_latency_s":0.121831}1705vm-test-run-nixbot-gitlab> gitlab # [  300.241324] gitaly[1367]: time="2026-06-29T22:10:47.058Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-29T22:10:57.007" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:47.057" grpc.time_ms=0.261 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1706vm-test-run-nixbot-gitlab> gitlab # [  300.252767] gitaly[1367]: time="2026-06-29T22:10:47.073Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-29T22:10:57.022" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:47.072" grpc.time_ms=0.548 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1707vm-test-run-nixbot-gitlab> gitlab # [  300.383967] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:47.251Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Projects::ProcessSyncEventsWorker","jid":"07c6f81d70ac3ac5a795f083","created_at":"2026-06-29T22:10:46.913Z","trace_propagation_headers":{"sentry-trace":"908cde3376f64fa89aa48dd63479215f-db4aff8814ce44e0","baggage":"sentry-trace_id=908cde3376f64fa89aa48dd63479215f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYN2GY1HGEBYBNKB0Q3WF","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"cell","meta.user":"root","meta.gl_user_id":1,"meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8f18dd753e91d7093aa53434170736240463ade652a5af40dc3edbef4e4c647e","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:46.929Z","job_size_bytes":2,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::ProcessSyncEventsWorker JID-07c6f81d70ac3ac5a795f083: done: 0.199769 sec","job_status":"done","queue_duration_s":0.121783,"scheduling_latency_s":0.121831,"redis_calls":14,"redis_duration_s":0.004389,"redis_read_bytes":140,"redis_write_bytes":1653,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000911,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":422,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001972,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":680,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001506,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":8,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.154334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.15650354,"extra.projects_process_sync_events_worker.estimated_total_events":1,"extra.projects_process_sync_events_worker.consumable_events":1,"extra.projects_process_sync_events_worker.processed_events":1,"duration_s":0.199769,"completed_at":"2026-06-29T22:10:47.250Z","load_balancing_strategy":"primary","db_duration_s":0.032727,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1708vm-test-run-nixbot-gitlab> gitlab # [  300.572598] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:47.439Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2c4d37cbc9e59dbee9816383","created_at":"2026-06-29T22:10:47.424Z","trace_propagation_headers":{"sentry-trace":"908cde3376f64fa89aa48dd63479215f-db4aff8814ce44e0","baggage":"sentry-trace_id=908cde3376f64fa89aa48dd63479215f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYN2GY1HGEBYBNKB0Q3WF","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:47.435Z","job_size_bytes":5,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2c4d37cbc9e59dbee9816383: start","job_status":"start","queue_duration_s":0.003783,"scheduling_latency_s":0.003832}1709vm-test-run-nixbot-gitlab> gitlab # [  300.682658] gitaly[1367]: time="2026-06-29T22:10:47.549Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYN2GY1HGEBYBNKB0Q3WF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-29T22:10:57.190" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:47.531" grpc.time_ms=17.823 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1710vm-test-run-nixbot-gitlab> gitlab # [  300.764610] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:47.631Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"authorized_project_update","args":["1","1"],"class":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker","jid":"2c4d37cbc9e59dbee9816383","created_at":"2026-06-29T22:10:47.424Z","trace_propagation_headers":{"sentry-trace":"908cde3376f64fa89aa48dd63479215f-db4aff8814ce44e0","baggage":"sentry-trace_id=908cde3376f64fa89aa48dd63479215f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYN2GY1HGEBYBNKB0Q3WF","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"permissions","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d4fffa6b61652ecbf8fd1e3329fcdddc8f7fd5d13476a16aa4467c900fae00b7","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:47.435Z","job_size_bytes":5,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"AuthorizedProjectUpdate::ProjectRecalculatePerUserWorker JID-2c4d37cbc9e59dbee9816383: done: 0.192362 sec","job_status":"done","queue_duration_s":0.003783,"scheduling_latency_s":0.003832,"redis_calls":12,"redis_duration_s":0.004807,"redis_read_bytes":138,"redis_write_bytes":1541,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001399,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":491,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.00274,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":784,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000668,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":14,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":14,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.019,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.152004,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043474,"duration_s":0.192362,"completed_at":"2026-06-29T22:10:47.631Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.029528,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1711vm-test-run-nixbot-gitlab> gitlab # [  300.861015] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:47.633Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"f5286abce014c91aef1a153c","created_at":"2026-06-29T22:10:47.477Z","trace_propagation_headers":{"sentry-trace":"908cde3376f64fa89aa48dd63479215f-db4aff8814ce44e0","baggage":"sentry-trace_id=908cde3376f64fa89aa48dd63479215f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYN2GY1HGEBYBNKB0Q3WF","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:47.487Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-f5286abce014c91aef1a153c: start","job_status":"start","queue_duration_s":0.146657,"scheduling_latency_s":0.146682}1712vm-test-run-nixbot-gitlab> gitlab # [  301.057531] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:47.924Z","retry":3,"queue":"default","version":0,"store":null,"args":["1"],"class":"Projects::PostCreationWorker","jid":"f5286abce014c91aef1a153c","created_at":"2026-06-29T22:10:47.477Z","trace_propagation_headers":{"sentry-trace":"908cde3376f64fa89aa48dd63479215f-db4aff8814ce44e0","baggage":"sentry-trace_id=908cde3376f64fa89aa48dd63479215f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYN2GY1HGEBYBNKB0Q3WF","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:115ed5a4f96bb7840d9513c0e53c69eaf78cc612f8a9b05f8b28bc5567d331ce","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:47.487Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Projects::PostCreationWorker JID-f5286abce014c91aef1a153c: done: 0.290698 sec","job_status":"done","queue_duration_s":0.146657,"scheduling_latency_s":0.146682,"redis_calls":11,"redis_duration_s":0.003922,"redis_read_bytes":137,"redis_write_bytes":1147,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.001222,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":407,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002027,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":538,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000673,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":202,"db_count":35,"db_write_count":6,"db_cached_count":2,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":35,"db_replica_write_count":0,"db_primary_write_count":6,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.039,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":6,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":2,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.238,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.238,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.037,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.190794,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00062112,"duration_s":0.290698,"completed_at":"2026-06-29T22:10:47.924Z","load_balancing_strategy":"primary","db_duration_s":0.103605,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1713vm-test-run-nixbot-gitlab> gitlab # [  301.154106] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:47.926Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"2965763766cb59e5f27a7f35","created_at":"2026-06-29T22:10:47.493Z","trace_propagation_headers":{"sentry-trace":"908cde3376f64fa89aa48dd63479215f-db4aff8814ce44e0","baggage":"sentry-trace_id=908cde3376f64fa89aa48dd63479215f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYN2GY1HGEBYBNKB0Q3WF","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:47.501Z","job_size_bytes":89,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-2965763766cb59e5f27a7f35: start","job_status":"start","queue_duration_s":0.425317,"scheduling_latency_s":0.425344}1714vm-test-run-nixbot-gitlab> gitlab # [  301.177538] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:48.028Z","retry":25,"queue":"default","version":0,"store":null,"args":["Projects::ProjectCreatedEvent","{\"project_id\"=\u003e1, \"namespace_id\"=\u003e1, \"root_namespace_id\"=\u003e1}"],"class":"Ci::InitializePipelinesIidSequenceWorker","jid":"2965763766cb59e5f27a7f35","created_at":"2026-06-29T22:10:47.493Z","trace_propagation_headers":{"sentry-trace":"908cde3376f64fa89aa48dd63479215f-db4aff8814ce44e0","baggage":"sentry-trace_id=908cde3376f64fa89aa48dd63479215f,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYN2GY1HGEBYBNKB0Q3WF","meta.caller_id":"POST /api/:version/projects","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:da4f511b278e5fec59a0525ff76c481fade26f467483004bc3dfa54e1876aecf","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:47.501Z","job_size_bytes":89,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::InitializePipelinesIidSequenceWorker JID-2965763766cb59e5f27a7f35: done: 0.102228 sec","job_status":"done","queue_duration_s":0.425317,"scheduling_latency_s":0.425344,"redis_calls":11,"redis_duration_s":0.003449,"redis_read_bytes":137,"redis_write_bytes":1267,"redis_feature_flag_calls":3,"redis_feature_flag_duration_s":0.000927,"redis_feature_flag_read_bytes":130,"redis_feature_flag_write_bytes":443,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001921,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":594,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000601,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":230,"db_count":9,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":9,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.027,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":3,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.009,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051466,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00050926,"duration_s":0.102228,"completed_at":"2026-06-29T22:10:48.028Z","load_balancing_strategy":"primary","db_duration_s":0.042367,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1715vm-test-run-nixbot-gitlab> gitlab # [  301.272176] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:48 +0000] "POST /api/v4/projects HTTP/1.1" 201 4795 "" "curl/8.20.0" 26821716vm-test-run-nixbot-gitlab> gitlab # [  301.277043] setup-gitlab-start[3268]: + mkdir -p /tmp/test-flake1717vm-test-run-nixbot-gitlab> gitlab # [  301.281642] setup-gitlab-start[3268]: + cd /tmp/test-flake1718vm-test-run-nixbot-gitlab> gitlab # [  301.282614] setup-gitlab-start[3268]: + git init -b master1719vm-test-run-nixbot-gitlab> gitlab # [  301.315842] setup-gitlab-start[3695]: Initialized empty Git repository in /tmp/test-flake/.git/1720vm-test-run-nixbot-gitlab> gitlab # [  301.317771] setup-gitlab-start[3268]: + git config user.name test1721vm-test-run-nixbot-gitlab> gitlab # [  301.321851] setup-gitlab-start[3268]: + git config user.email test@example.com1722vm-test-run-nixbot-gitlab> gitlab # [  301.328742] setup-gitlab-start[3268]: + cat1723vm-test-run-nixbot-gitlab> gitlab # [  301.333486] setup-gitlab-start[3268]: + git add flake.nix1724vm-test-run-nixbot-gitlab> gitlab # [  301.341926] setup-gitlab-start[3268]: + git commit -m 'initial commit'1725vm-test-run-nixbot-gitlab> gitlab # [  301.361671] setup-gitlab-start[3700]: [master (root-commit) d37e0a8] initial commit1726vm-test-run-nixbot-gitlab> gitlab # [  301.364518] setup-gitlab-start[3700]:  1 file changed, 10 insertions(+)1727vm-test-run-nixbot-gitlab> gitlab # [  301.366945] setup-gitlab-start[3700]:  create mode 100644 flake.nix1728vm-test-run-nixbot-gitlab> gitlab # [  301.369467] setup-gitlab-start[3268]: + git remote add origin http://oauth2:glpat-tArzOoBU79Xcu9gJp5oAoW86MQp1OjEH.01.0w0x1ovkm@gitlab/root/test-flake.git1729vm-test-run-nixbot-gitlab> gitlab # [  301.374547] setup-gitlab-start[3268]: + git push -u origin master1730vm-test-run-nixbot-gitlab> gitlab # [  301.498182] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:48 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 731731vm-test-run-nixbot-gitlab> gitlab # [  301.655433] gitaly[1367]: time="2026-06-29T22:10:48.522Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=582 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYQXE8F64J16GD56BG64C grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=242 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:48.512" grpc.time_ms=10.774 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1732vm-test-run-nixbot-gitlab> gitlab # [  301.674152] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:48 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.54.0" 1561733vm-test-run-nixbot-gitlab> gitlab # [  302.736780] gitaly[1367]: time="2026-06-29T22:10:49.603Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-29T22:10:59.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:49.594" grpc.time_ms=8.84 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1734vm-test-run-nixbot-gitlab> gitlab # [  302.784431] gitaly[1367]: time="2026-06-29T22:10:49.651Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=4 command.system_time_ms=5 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-06-29T22:11:19.042" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-06-29T22:10:49.642" grpc.time_ms=8.79 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1735vm-test-run-nixbot-gitlab> gitlab # [  302.848064] gitaly[1367]: time="2026-06-29T22:10:49.715Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 duration_ms=297ns method=POST pid=1367 status=200 url="http://unix/api/v4/internal/allowed"1736vm-test-run-nixbot-gitlab> gitlab # [  302.881771] gitaly[1367]: time="2026-06-29T22:10:49.749Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 duration_ms=32ns method=POST pid=1367 status=200 url="http://unix/api/v4/internal/pre_receive"1737vm-test-run-nixbot-gitlab> gitlab # [  302.895383] gitaly[1367]: time="2026-06-29T22:10:49.749Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5318 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:49.416" grpc.time_ms=332.671 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1738vm-test-run-nixbot-gitlab> gitlab # [  302.940643] gitaly[1367]: time="2026-06-29T22:10:49.808Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4788 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:49.806" grpc.time_ms=1.363 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1739vm-test-run-nixbot-gitlab> gitlab # [  303.005373] gitaly[1367]: time="2026-06-29T22:10:49.872Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:49.871" grpc.time_ms=0.747 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1740vm-test-run-nixbot-gitlab> gitlab # [  303.049568] gitaly[1367]: time="2026-06-29T22:10:49.917Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4789 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:49.916" grpc.time_ms=0.725 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1741vm-test-run-nixbot-gitlab> gitlab # [  303.163675] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:50.028Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 d37e0a8fdb837bb47bfcf157da75dcaf302b1dcf refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"cd59c78c828ac6cf29fbd2de","created_at":"2026-06-29T22:10:50.014Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-88483040d25f4813","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:50.026Z","job_size_bytes":185,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-cd59c78c828ac6cf29fbd2de: start","job_status":"start","queue_duration_s":0.00223,"scheduling_latency_s":0.002269}1742vm-test-run-nixbot-gitlab> gitlab # [  303.210314] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:50.058Z","message":"changes: \"0000000000000000000000000000000000000000 d37e0a8fdb837bb47bfcf157da75dcaf302b1dcf refs/heads/master\\n\""}1743vm-test-run-nixbot-gitlab> gitlab # [  303.217128] gitaly[1367]: time="2026-06-29T22:10:50.071Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-29T22:11:00.002" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:50.052" grpc.time_ms=18.021 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1744vm-test-run-nixbot-gitlab> gitlab # [  303.239429] gitaly[1367]: time="2026-06-29T22:10:50.104Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=18 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-29T22:11:00.004" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:50.085" grpc.time_ms=19.301 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1745vm-test-run-nixbot-gitlab> gitlab # [  303.257445] gitaly[1367]: time="2026-06-29T22:10:50.115Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=16 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1436 command.oublock=0 command.real_time_ms=25 command.spawn_token_fork_ms=11 command.system_time_ms=13 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-06-29T22:11:00.035" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:50.086" grpc.time_ms=29.107 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1746vm-test-run-nixbot-gitlab> gitlab # [  303.276195] gitaly[1367]: time="2026-06-29T22:10:50.142Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=6 command.system_time_ms=3 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-29T22:11:00.050" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:50.131" grpc.time_ms=10.758 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1747vm-test-run-nixbot-gitlab> gitlab # [  303.291360] gitaly[1367]: time="2026-06-29T22:10:50.147Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 duration_ms=186ns method=POST pid=1367 status=200 url="http://unix/api/v4/internal/post_receive"1748vm-test-run-nixbot-gitlab> gitlab # [  303.294734] gitaly[1367]: time="2026-06-29T22:10:50.148Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4812 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:49.960" grpc.time_ms=187.477 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1749vm-test-run-nixbot-gitlab> gitlab # [  303.306777] gitaly[1367]: time="2026-06-29T22:10:50.167Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 diskcache=a7176891-2529-4474-bb84-dd2c600f2bd8 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:49.302" pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1750vm-test-run-nixbot-gitlab> gitlab # [  303.317975] setup-gitlab-start[3704]: To http://gitlab/root/test-flake.git1751vm-test-run-nixbot-gitlab> gitlab # [  303.318960] setup-gitlab-start[3704]:  * [new branch]      master -> master1752vm-test-run-nixbot-gitlab> gitlab # [  303.319943] setup-gitlab-start[3704]: branch 'master' set up to track 'origin/master'.1753vm-test-run-nixbot-gitlab> gitlab # [  303.321550] gitlab-workhorse[1291]: time="2026-06-29T22:10:50Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521754vm-test-run-nixbot-gitlab> gitlab # [  303.323612] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:50 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 16261755vm-test-run-nixbot-gitlab> gitlab # [  303.326104] systemd[1]: Finished setup-gitlab.service.1756vm-test-run-nixbot-gitlab> gitlab # [  303.326935] gitaly[1367]: time="2026-06-29T22:10:50.167Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=310 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=851968 command.minflt=13201 command.oublock=32 command.real_time_ms=852 command.spawn_token_fork_ms=2 command.system_time_ms=171 command.user_time_ms=139 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=685 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=56 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:49.302" grpc.time_ms=864.873 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1757vm-test-run-nixbot-gitlab> gitlab # [  303.341898] systemd[1]: Starting nixbot CI service...1758vm-test-run-nixbot-gitlab> gitlab # [  303.342675] gitaly[1367]: time="2026-06-29T22:10:50.192Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=8 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-06-29T22:11:00.098" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=226 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:50.178" grpc.time_ms=14.029 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1759vm-test-run-nixbot-gitlab> gitlab # [  303.361513] gitaly[1367]: time="2026-06-29T22:10:50.229Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3938 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:50.228" grpc.time_ms=0.324 pid=1367 span.kind=server system=grpc1760vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit setup-gitlab.service, in 304.00 seconds)1761vm-test-run-nixbot-gitlab> gitlab # [  303.395263] gitaly[1367]: time="2026-06-29T22:10:50.262Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3940 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:50.262" grpc.time_ms=0.528 pid=1367 span.kind=server system=grpc1762vm-test-run-nixbot-gitlab> gitlab: waiting for unit nixbot.service1763vm-test-run-nixbot-gitlab> gitlab # [  303.410530] gitaly[1367]: time="2026-06-29T22:10:50.278Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 diskcache=f81cdaaa-b006-415c-9bff-2fb81936b39c grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-29T22:11:00.122" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:50.202" pid=1367 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1764vm-test-run-nixbot-gitlab> gitlab # [  303.421268] gitaly[1367]: time="2026-06-29T22:10:50.278Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=65 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=4829 command.oublock=8 command.real_time_ms=71 command.spawn_token_fork_ms=2 command.system_time_ms=46 command.user_time_ms=19 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-29T22:11:00.122" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=148 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:50.202" grpc.time_ms=75.997 pid=1367 ref=HEAD remote_ip="2001:db8:1::1" revision=refs/heads/master span.kind=server system=grpc username=root1765vm-test-run-nixbot-gitlab> gitlab # [  303.436251] gitaly[1367]: time="2026-06-29T22:10:50.296Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-06-29T22:11:00.215" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:50.296" grpc.time_ms=0.15 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1766vm-test-run-nixbot-gitlab> gitlab # [  303.450206] gitaly[1367]: time="2026-06-29T22:10:50.317Z" level=info msg="finished unary call with code OK" command.count=3 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=861 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=8 command.system_time_ms=8 command.user_time_ms=5 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-06-29T22:11:00.219" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:50.300" grpc.time_ms=17.321 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1767vm-test-run-nixbot-gitlab> gitlab # [  303.551705] gitaly[1367]: time="2026-06-29T22:10:50.419Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=313 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindCommits grpc.request.deadline="2026-06-29T22:11:20.008" grpc.request.fullMethod=/gitaly.CommitService/FindCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=173 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:50.409" grpc.time_ms=9.851 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1768vm-test-run-nixbot-gitlab> gitlab # [  303.582434] gitaly[1367]: time="2026-06-29T22:10:50.449Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-29T22:11:00.007" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:50.448" grpc.time_ms=0.582 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1769vm-test-run-nixbot-gitlab> gitlab # [  303.598871] gitaly[1367]: time="2026-06-29T22:10:50.461Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=316 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-06-29T22:11:00.011" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=112 grpc.service=gitaly.DiffService grpc.start_time="2026-06-29T22:10:50.451" grpc.time_ms=10.273 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1770vm-test-run-nixbot-gitlab> gitlab # [  303.618360] gitaly[1367]: time="2026-06-29T22:10:50.485Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=4 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-29T22:11:00.037" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:50.478" grpc.time_ms=7.071 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1771vm-test-run-nixbot-gitlab> gitlab # [  303.637595] gitaly[1367]: time="2026-06-29T22:10:50.504Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=5 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-29T22:11:00.050" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:50.490" grpc.time_ms=13.375 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1772vm-test-run-nixbot-gitlab> gitlab # [  303.675190] gitaly[1367]: time="2026-06-29T22:10:50.542Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=885 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=9 command.user_time_ms=5 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-29T22:11:20.124" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:50.524" grpc.time_ms=17.881 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1773vm-test-run-nixbot-gitlab> gitlab # [  304.114295] gitaly[1367]: time="2026-06-29T22:10:50.981Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-06-29T22:11:00.009" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:50.979" grpc.time_ms=1.581 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1774vm-test-run-nixbot-gitlab> gitlab # [  304.160204] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:51.027Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","0000000000000000000000000000000000000000 d37e0a8fdb837bb47bfcf157da75dcaf302b1dcf refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"cd59c78c828ac6cf29fbd2de","created_at":"2026-06-29T22:10:50.014Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-88483040d25f4813","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:50.026Z","job_size_bytes":185,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-cd59c78c828ac6cf29fbd2de: done: 0.998645 sec","job_status":"done","queue_duration_s":0.00223,"scheduling_latency_s":0.002269,"gitaly_calls":13,"gitaly_duration_s":0.241222,"redis_calls":200,"redis_allowed_cross_slot_calls":6,"redis_duration_s":0.053084,"redis_read_bytes":941,"redis_write_bytes":19812,"redis_cache_calls":14,"redis_cache_duration_s":0.003256,"redis_cache_read_bytes":16,"redis_cache_write_bytes":884,"redis_feature_flag_calls":32,"redis_feature_flag_duration_s":0.008636,"redis_feature_flag_read_bytes":540,"redis_feature_flag_write_bytes":4279,"redis_queues_calls":8,"redis_queues_duration_s":0.001027,"redis_queues_read_bytes":8,"redis_queues_write_bytes":4936,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002778,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1259,"redis_repository_cache_calls":91,"redis_repository_cache_allowed_cross_slot_calls":6,"redis_repository_cache_duration_s":0.022564,"redis_repository_cache_read_bytes":233,"redis_repository_cache_write_bytes":6319,"redis_shared_state_calls":46,"redis_shared_state_duration_s":0.014823,"redis_shared_state_read_bytes":133,"redis_shared_state_write_bytes":2135,"db_count":51,"db_write_count":8,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":51,"db_replica_write_count":0,"db_primary_write_count":8,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.06,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":51,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":8,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.326,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.349,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.06,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.642621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00078022,"exclusive_lock_hold_duration_s":0.03580142,"duration_s":0.998645,"completed_at":"2026-06-29T22:10:51.027Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.097452,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1775vm-test-run-nixbot-gitlab> gitlab # [  304.298658] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:51.029Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"80834b2ba6704876405bdc49","created_at":"2026-06-29T22:10:50.146Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-38e3930e5af94445","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:50.154Z","job_size_bytes":46,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-80834b2ba6704876405bdc49: start","job_status":"start","queue_duration_s":0.875044,"scheduling_latency_s":0.875066}1776vm-test-run-nixbot-gitlab> gitlab # [  304.321387] gitaly[1367]: time="2026-06-29T22:10:51.096Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryInfo grpc.request.deadline="2026-06-30T04:10:51.087" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryInfo grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:51.088" grpc.time_ms=7.541 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1777vm-test-run-nixbot-gitlab> gitlab # [  304.336890] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:51.172Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"80834b2ba6704876405bdc49","created_at":"2026-06-29T22:10:50.146Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-38e3930e5af94445","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:50.154Z","job_size_bytes":46,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-80834b2ba6704876405bdc49: done: 0.143034 sec","job_status":"done","queue_duration_s":0.875044,"scheduling_latency_s":0.875066,"gitaly_calls":2,"gitaly_duration_s":0.03012,"redis_calls":30,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.010708,"redis_read_bytes":68,"redis_write_bytes":4887,"redis_feature_flag_calls":6,"redis_feature_flag_duration_s":0.002257,"redis_feature_flag_read_bytes":6,"redis_feature_flag_write_bytes":1005,"redis_queues_calls":3,"redis_queues_duration_s":0.000994,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2116,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003275,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":710,"redis_repository_cache_calls":11,"redis_repository_cache_allowed_cross_slot_calls":2,"redis_repository_cache_duration_s":0.003222,"redis_repository_cache_read_bytes":48,"redis_repository_cache_write_bytes":752,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.00096,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":304,"db_count":10,"db_write_count":2,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":10,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":2,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.004,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.004,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00092536,"duration_s":0.143034,"completed_at":"2026-06-29T22:10:51.172Z","load_balancing_strategy":"primary","db_duration_s":0.016036,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1778vm-test-run-nixbot-gitlab> gitlab # [  304.404411] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:51.175Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"0b777685eafa1455347f41f4","created_at":"2026-06-29T22:10:50.170Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-38e3930e5af94445","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:50.175Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-0b777685eafa1455347f41f4: start","job_status":"start","queue_duration_s":1.000277,"scheduling_latency_s":1.000316}1779vm-test-run-nixbot-gitlab> gitlab # [  304.425435] gitaly[1367]: time="2026-06-29T22:10:51.122Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=593 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-06-29T22:11:21.004" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:51.105" grpc.time_ms=17.211 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1780vm-test-run-nixbot-gitlab> gitlab # [  304.442231] gitaly[1367]: time="2026-06-29T22:10:51.255Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 diskcache=174f74b8-1d38-4b93-b3c0-15195e5bbe61 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-30T04:10:51.218" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:51.218" pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1781vm-test-run-nixbot-gitlab> gitlab # [  304.454114] gitaly[1367]: time="2026-06-29T22:10:51.256Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=4 command.cpu_time_ms=26 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1176 command.oublock=0 command.real_time_ms=43 command.spawn_token_fork_ms=3 command.system_time_ms=15 command.user_time_ms=11 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-30T04:10:51.218" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:51.218" grpc.time_ms=37.034 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1782vm-test-run-nixbot-gitlab> gitlab # [  304.471358] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:51.310Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"0b777685eafa1455347f41f4","created_at":"2026-06-29T22:10:50.170Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-38e3930e5af94445","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:50.175Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-0b777685eafa1455347f41f4: done: 0.134646 sec","job_status":"done","queue_duration_s":1.000277,"scheduling_latency_s":1.000316,"gitaly_calls":1,"gitaly_duration_s":0.039958,"redis_calls":15,"redis_duration_s":0.005738,"redis_read_bytes":68,"redis_write_bytes":1520,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000605,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":558,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.00085,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00157,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":520,"db_count":12,"db_write_count":4,"db_cached_count":0,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":4,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":2,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":4,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.015,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.027,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.066331,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.09224763999999999,"duration_s":0.134646,"completed_at":"2026-06-29T22:10:51.310Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.020289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1783vm-test-run-nixbot-gitlab> gitlab # [  304.521607] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:51.312Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"6a8f071064f766a244403a48","created_at":"2026-06-29T22:10:50.292Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-38e3930e5af94445","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:50.293Z","job_size_bytes":23,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-6a8f071064f766a244403a48: start","job_status":"start","queue_duration_s":1.018693,"scheduling_latency_s":1.018717}1784vm-test-run-nixbot-gitlab> gitlab # [  304.538625] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:51.375Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"commit_count\"]"],"class":"ProjectCacheWorker","jid":"6a8f071064f766a244403a48","created_at":"2026-06-29T22:10:50.292Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-38e3930e5af94445","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:9a580f4ed3b98848550cd9d8a9e00b9c6cdb806321df08c03ad3e2050bcedc4f","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:50.293Z","job_size_bytes":23,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-6a8f071064f766a244403a48: done: 0.063446 sec","job_status":"done","queue_duration_s":1.018693,"scheduling_latency_s":1.018717,"gitaly_calls":1,"gitaly_duration_s":0.013056,"redis_calls":16,"redis_duration_s":0.0060669999999999995,"redis_read_bytes":52,"redis_write_bytes":2049,"redis_queues_calls":1,"redis_queues_duration_s":0.001535,"redis_queues_read_bytes":1,"redis_queues_write_bytes":980,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00136,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":7,"redis_repository_cache_duration_s":0.00227,"redis_repository_cache_read_bytes":44,"redis_repository_cache_write_bytes":344,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":288,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.063446,"completed_at":"2026-06-29T22:10:51.375Z","load_balancing_strategy":"primary","db_duration_s":0.004733,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1785vm-test-run-nixbot-gitlab> gitlab # [  304.585670] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:51.378Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f6070ac5ea7fb0e1ab5e31c1","created_at":"2026-06-29T22:10:50.927Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-38e3930e5af94445","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c26494dd388ae64b789f57ac69bc92fd587fc2afba1f51b05434d85cd0c39b22","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:50.933Z","job_size_bytes":467,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f6070ac5ea7fb0e1ab5e31c1: start","job_status":"start","queue_duration_s":0.445156,"scheduling_latency_s":0.445181}1786vm-test-run-nixbot-gitlab> gitlab # [  304.603988] gitaly[1367]: time="2026-06-29T22:10:51.362Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=7 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=593 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CountCommits grpc.request.deadline="2026-06-29T22:11:21.251" grpc.request.fullMethod=/gitaly.CommitService/CountCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:51.352" grpc.time_ms=10.278 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1787vm-test-run-nixbot-gitlab> gitlab # [  304.617711] nixbot[3806]: {"ts": "2026-06-29T22:10:51.358Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1788vm-test-run-nixbot-gitlab> gitlab # [  304.620247] nixbot[3806]: {"ts": "2026-06-29T22:10:51.397Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1789vm-test-run-nixbot-gitlab> gitlab # [  304.622274] nixbot[3806]: {"ts": "2026-06-29T22:10:51.433Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1790vm-test-run-nixbot-gitlab> gitlab # [  304.624888] nixbot[3806]: {"ts": "2026-06-29T22:10:51.440Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1791vm-test-run-nixbot-gitlab> gitlab # [  304.627151] nixbot[3806]: {"ts": "2026-06-29T22:10:51.446Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1792vm-test-run-nixbot-gitlab> gitlab # [  304.629318] nixbot[3806]: {"ts": "2026-06-29T22:10:51.455Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1793vm-test-run-nixbot-gitlab> gitlab # [  304.631479] nixbot[3806]: {"ts": "2026-06-29T22:10:51.459Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1794vm-test-run-nixbot-gitlab> gitlab # [  304.633885] nixbot[3806]: {"ts": "2026-06-29T22:10:51.461Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1795vm-test-run-nixbot-gitlab> gitlab # [  304.635953] nixbot[3806]: {"ts": "2026-06-29T22:10:51.468Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1796vm-test-run-nixbot-gitlab> gitlab # [  304.638334] nixbot[3806]: {"ts": "2026-06-29T22:10:51.469Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1797vm-test-run-nixbot-gitlab> gitlab # [  304.640660] nixbot[3806]: {"ts": "2026-06-29T22:10:51.476Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1798vm-test-run-nixbot-gitlab> gitlab # [  304.642726] nixbot[3806]: {"ts": "2026-06-29T22:10:51.483Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1799vm-test-run-nixbot-gitlab> gitlab # [  304.644967] gitaly[1367]: time="2026-06-29T22:10:51.440Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:21.338" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:51.439" grpc.time_ms=1.066 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1800vm-test-run-nixbot-gitlab> gitlab # [  304.657826] nixbot[3806]: {"ts": "2026-06-29T22:10:51.488Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1801vm-test-run-nixbot-gitlab> gitlab # [  304.661571] nixbot[3806]: {"ts": "2026-06-29T22:10:51.490Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1802vm-test-run-nixbot-gitlab> gitlab # [  304.663884] nixbot[3806]: {"ts": "2026-06-29T22:10:51.495Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1803vm-test-run-nixbot-gitlab> gitlab # [  304.666480] nixbot[3806]: {"ts": "2026-06-29T22:10:51.498Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1804vm-test-run-nixbot-gitlab> gitlab # [  304.668649] nixbot[3806]: {"ts": "2026-06-29T22:10:51.500Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1805vm-test-run-nixbot-gitlab> gitlab # [  304.670803] nixbot[3806]: {"ts": "2026-06-29T22:10:51.501Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1806vm-test-run-nixbot-gitlab> gitlab # [  304.672875] nixbot[3806]: {"ts": "2026-06-29T22:10:51.505Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1807vm-test-run-nixbot-gitlab> gitlab # [  304.675266] gitaly[1367]: time="2026-06-29T22:10:51.455Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=1 command.system_time_ms=6 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-29T22:11:01.002" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:51.443" grpc.time_ms=12.28 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1808vm-test-run-nixbot-gitlab> gitlab # [  304.744056] gitaly[1367]: time="2026-06-29T22:10:51.611Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-29T22:11:21.510" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:51.610" grpc.time_ms=1.021 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1809vm-test-run-nixbot-gitlab> gitlab # [  304.765968] gitaly[1367]: time="2026-06-29T22:10:51.623Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=24 command.oublock=0 command.real_time_ms=2 command.spawn_token_fork_ms=1 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-06-29T22:11:21.519" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:51.620" grpc.time_ms=3.542 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1810vm-test-run-nixbot-gitlab> gitlab # [  304.952311] gitaly[1367]: time="2026-06-29T22:10:51.819Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-29T22:11:01.001" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:51.802" grpc.time_ms=17.242 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1811vm-test-run-nixbot-gitlab> gitlab # [  304.993895] nixbot[3806]: INFO:     Started server process [3806]1812vm-test-run-nixbot-gitlab> gitlab # [  304.996644] nixbot[3806]: INFO:     Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1813vm-test-run-nixbot-gitlab> gitlab # [  305.000630] nixbot[3806]: INFO:     ::ffff:127.0.0.1:43848 - "GET /health HTTP/1.1" 200 OK1814vm-test-run-nixbot-gitlab> gitlab # [  305.007578] systemd[1]: Started nixbot CI service.1815vm-test-run-nixbot-gitlab> gitlab # [  305.011567] systemd[1]: Reached target Multi-User System.1816vm-test-run-nixbot-gitlab> gitlab # [  305.015201] systemd[1]: Startup finished in 764ms (kernel) + 5.934s (initrd) + 4min 58.315s (userspace) = 5min 5.014s.1817vm-test-run-nixbot-gitlab> gitlab # [  305.378548] gitaly[1367]: time="2026-06-29T22:10:52.244Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=19 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=881 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=9 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYVAWDPDFN30Y2D4D67TA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-29T22:11:22.016" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=80 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:52.216" grpc.time_ms=28.211 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1818vm-test-run-nixbot-gitlab> gitlab # [  305.430230] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:52 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 4281819vm-test-run-nixbot-gitlab> gitlab # [  305.433765] nixbot[3806]: {"ts": "2026-06-29T22:10:52.299Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1820vm-test-run-nixbot-gitlab> gitlab # [  305.473053] nixbot[3806]: {"ts": "2026-06-29T22:10:52.340Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1821vm-test-run-nixbot-gitlab> gitlab # [  305.584523] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:52 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 991822vm-test-run-nixbot-gitlab> gitlab # [  305.591132] nixbot[3806]: {"ts": "2026-06-29T22:10:52.453Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1823vm-test-run-nixbot-gitlab> gitlab # [  305.598226] nixbot[3806]: {"ts": "2026-06-29T22:10:52.456Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1824vm-test-run-nixbot-gitlab> gitlab # [  305.648146] gitaly[1367]: time="2026-06-29T22:10:52.514Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=882 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=1 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-29T22:11:22.401" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:52.501" grpc.time_ms=13.306 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1825vm-test-run-nixbot-gitlab> gitlab # [  305.688283] gitaly[1367]: time="2026-06-29T22:10:52.541Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYR2X5BZRYE0BTMNWHEZ3 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-06-29T22:11:22.418" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:52.518" grpc.time_ms=22.235 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1826vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit nixbot.service, in 2.18 seconds)1827vm-test-run-nixbot-gitlab> gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1828vm-test-run-nixbot-gitlab> gitlab # [  305.725925] sidekiq-cluster[2440]: {"severity":"WARN","time":"2026-06-29T22:10:52.592Z","class":"CreatePipelineWorker","correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"0000000000000000000000000000000000000000","after":"d37e0a8fdb837bb47bfcf157da75dcaf302b1dcf","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"d37e0a8fdb837bb47bfcf157da75dcaf302b1dcf","ref":"refs/heads/master"},"retry":0}1829vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.04 seconds)1830vm-test-run-nixbot-gitlab> subtest: project discovered and webhook registered1831vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1832vm-test-run-nixbot-gitlab> gitlab # [  305.741086] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:52.601Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"f6070ac5ea7fb0e1ab5e31c1","created_at":"2026-06-29T22:10:50.927Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-38e3930e5af94445","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:c26494dd388ae64b789f57ac69bc92fd587fc2afba1f51b05434d85cd0c39b22","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:50.933Z","job_size_bytes":467,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-f6070ac5ea7fb0e1ab5e31c1: done: 1.222777 sec","job_status":"done","queue_duration_s":0.445156,"scheduling_latency_s":0.445181,"gitaly_calls":7,"gitaly_duration_s":0.092883,"redis_calls":53,"redis_duration_s":0.026095,"redis_read_bytes":171,"redis_write_bytes":4427,"redis_cache_calls":4,"redis_cache_duration_s":0.00223,"redis_cache_read_bytes":10,"redis_cache_write_bytes":343,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.013433,"redis_feature_flag_read_bytes":18,"redis_feature_flag_write_bytes":2433,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001381,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":510,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.004206,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.004845,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":513,"db_count":40,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":40,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.07,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":35,"db_ci_count":5,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.063,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.986535,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033816,"duration_s":1.222777,"completed_at":"2026-06-29T22:10:52.600Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.129555,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1833vm-test-run-nixbot-gitlab> gitlab # [  305.826753] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:52.603Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"a45e8a575c19410b05317345","created_at":"2026-06-29T22:10:51.139Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-880e088ce0734796","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:51.147Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-a45e8a575c19410b05317345: start","job_status":"start","queue_duration_s":1.455506,"scheduling_latency_s":1.455527}1834vm-test-run-nixbot-gitlab> gitlab # [  305.846146] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:52.661Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::ScheduleAggregationWorker","jid":"a45e8a575c19410b05317345","created_at":"2026-06-29T22:10:51.139Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-880e088ce0734796","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"ProjectCacheWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:11bf4ab06a7a45f7b8fa79a254215eacd563749d4b07a335325f4d171a5a896a","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:51.147Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ScheduleAggregationWorker JID-a45e8a575c19410b05317345: done: 0.058346 sec","job_status":"done","queue_duration_s":1.455506,"scheduling_latency_s":1.455527,"redis_calls":19,"redis_duration_s":0.010194,"redis_read_bytes":21,"redis_write_bytes":4291,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.005484,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":678,"redis_queues_calls":3,"redis_queues_duration_s":0.000973,"redis_queues_read_bytes":3,"redis_queues_write_bytes":2262,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002604,"redis_queues_metadata_read_bytes":9,"redis_queues_metadata_write_bytes":1024,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001133,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":327,"db_count":7,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":7,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.003,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03804,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01073764,"duration_s":0.058346,"completed_at":"2026-06-29T22:10:52.661Z","load_balancing_strategy":"primary","db_duration_s":0.005986,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1835vm-test-run-nixbot-gitlab> gitlab # [  305.895206] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:52.662Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"4d307327ba2b63af0ccdd473","created_at":"2026-06-29T22:10:52.644Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-9fe981e9df0a4827","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:52.651Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-4d307327ba2b63af0ccdd473: start","job_status":"start","queue_duration_s":0.010867,"scheduling_latency_s":0.010885}1836vm-test-run-nixbot-gitlab> gitlab # [  305.913236] nixbot[3806]: {"ts": "2026-06-29T22:10:52.612Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1837vm-test-run-nixbot-gitlab> gitlab # [  305.915579] nixbot[3806]: INFO:     ::ffff:127.0.0.1:43860 - "GET /health HTTP/1.1" 200 OK1838vm-test-run-nixbot-gitlab> gitlab # [  305.916807] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:52 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 868 "" "python-httpx/0.28.1" 1491839vm-test-run-nixbot-gitlab> gitlab # [  306.003027] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:52.868Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"update_namespace_statistics","args":["1"],"class":"Namespaces::RootStatisticsWorker","jid":"4d307327ba2b63af0ccdd473","created_at":"2026-06-29T22:10:52.644Z","trace_propagation_headers":{"sentry-trace":"4889e4c2d80b45f9b9fe4ce49e0eabc2-9fe981e9df0a4827","baggage":"sentry-trace_id=4889e4c2d80b45f9b9fe4ce49e0eabc2,sentry-release=Unknown"},"correlation_id":"01KWAPYR2X5BZRYE0BTMNWHEZ3","meta.caller_id":"Namespaces::ScheduleAggregationWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:fdeb2b3453eb1185da615072e7fac8965876ce3585e2a5a18dfd6ce2ee6520d8","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:52.651Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::RootStatisticsWorker JID-4d307327ba2b63af0ccdd473: done: 0.205773 sec","job_status":"done","queue_duration_s":0.010867,"scheduling_latency_s":0.010885,"redis_calls":11,"redis_duration_s":0.00301,"redis_read_bytes":10,"redis_write_bytes":1189,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000425,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.002004,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":672,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000581,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":210,"db_count":12,"db_write_count":3,"db_cached_count":0,"db_txn_count":3,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.014,"db_main_txn_count":3,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":12,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.003,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.008,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.014,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.177649,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00073806,"duration_s":0.205773,"completed_at":"2026-06-29T22:10:52.868Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.021667,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1840vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.46 seconds)1841vm-test-run-nixbot-gitlab> [{'id': 1, 'url': 'http://buildbot:8010/webhooks/gitlab', 'name': None, 'description': None, 'created_at': '2026-06-29T22:10:52.592Z', 'push_events': True, 'tag_push_events': False, 'merge_requests_events': True, 'repository_update_events': False, 'enable_ssl_verification': True, 'alert_status': 'executable', 'disabled_until': None, 'push_events_branch_filter': None, 'branch_filter_strategy': 'wildcard', 'custom_webhook_template': None, 'project_id': 1, 'issues_events': False, 'confidential_issues_events': False, 'note_events': False, 'confidential_note_events': None, 'pipeline_events': False, 'wiki_page_events': False, 'deployment_events': False, 'feature_flag_events': False, 'job_events': False, 'releases_events': False, 'milestone_events': False, 'emoji_events': False, 'resource_access_token_events': False, 'resource_deploy_token_events': False, 'vulnerability_events': False}]1842vm-test-run-nixbot-gitlab> gitlab # [  306.240264] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:53 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "curl/8.20.0" 4261843vm-test-run-nixbot-gitlab> (finished: subtest: project discovered and webhook registered, in 0.46 seconds)1844vm-test-run-nixbot-gitlab> subtest: push delivers the webhook1845vm-test-run-nixbot-gitlab> gitlab: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master1846vm-test-run-nixbot-gitlab> gitlab # [  306.387986] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:53 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.54.0" 451847vm-test-run-nixbot-gitlab> gitlab # [  306.550226] gitaly[1367]: time="2026-06-29T22:10:53.416Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=21 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWPGJTCHMHB7HR8BDRA9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=246 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:53.392" grpc.time_ms=23.86 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1848vm-test-run-nixbot-gitlab> gitlab # Enumerating objects: 5, done.1849vm-test-run-nixbot-gitlab> gitlab # Counting objects:  20% (1/5)[  306.587929] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:53 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 201 "" "git/2.54.0" 1531850vm-test-run-nixbot-gitlab> gitlab # Counting objects:  40% (2/5)Counting objects:  60% (3/5)Counting objects:  80% (4/5)Counting objects: 100% (5/5)Counting objects: 100% (5/5), done.1851vm-test-run-nixbot-gitlab> gitlab # Delta compression using up to 4 threads1852vm-test-run-nixbot-gitlab> gitlab # Compressing objects:  50% (1/2)Compressing objects: 100% (2/2)Compressing objects: 100% (2/2), done.1853vm-test-run-nixbot-gitlab> gitlab # Writing objects:  33% (1/3)Writing objects:  66% (2/3)Writing objects: 100% (3/3)Writing objects: 100% (3/3), 273 bytes | 91.00 KiB/s, done.1854vm-test-run-nixbot-gitlab> gitlab # Total 3 (delta 1), reused 0 (delta 0), pack-reused 0 (from 0)1855vm-test-run-nixbot-gitlab> gitlab # [  306.952241] gitaly[1367]: time="2026-06-29T22:10:53.819Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=590 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-06-29T22:11:03.040" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=253 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:53.801" grpc.time_ms=18.055 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1856vm-test-run-nixbot-gitlab> gitlab # [  307.108465] gitaly[1367]: time="2026-06-29T22:10:53.975Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=301 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-06-29T22:11:23.758" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-06-29T22:10:53.959" grpc.time_ms=16.192 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1857vm-test-run-nixbot-gitlab> gitlab # [  307.190720] gitaly[1367]: time="2026-06-29T22:10:54.058Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01KWAPYWX1JYJ1JDA3913EASWD duration_ms=345ns method=POST pid=1367 status=200 url="http://unix/api/v4/internal/allowed"1858vm-test-run-nixbot-gitlab> gitlab # [  307.244972] gitaly[1367]: time="2026-06-29T22:10:54.112Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01KWAPYWX1JYJ1JDA3913EASWD duration_ms=53ns method=POST pid=1367 status=200 url="http://unix/api/v4/internal/pre_receive"1859vm-test-run-nixbot-gitlab> gitlab # [  307.262196] gitaly[1367]: time="2026-06-29T22:10:54.112Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5318 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:53.711" grpc.time_ms=401.168 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1860vm-test-run-nixbot-gitlab> gitlab # [  307.294091] nixbot[3806]: {"ts": "2026-06-29T22:10:54.123Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1861vm-test-run-nixbot-gitlab> gitlab # [  307.300347] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:54 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4876 "" "python-httpx/0.28.1" 14901862vm-test-run-nixbot-gitlab> gitlab # [  307.305394] gitaly[1367]: time="2026-06-29T22:10:54.162Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4788 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:54.162" grpc.time_ms=0.546 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1863vm-test-run-nixbot-gitlab> gitlab # [  307.335272] gitaly[1367]: time="2026-06-29T22:10:54.202Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:54.202" grpc.time_ms=0.4 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1864vm-test-run-nixbot-gitlab> gitlab # [  307.359564] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 831 "" "python-httpx/0.28.1" 701865vm-test-run-nixbot-gitlab> gitlab # [  307.363622] nixbot[3806]: {"ts": "2026-06-29T22:10:54.212Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1866vm-test-run-nixbot-gitlab> gitlab # [  307.377191] gitaly[1367]: time="2026-06-29T22:10:54.244Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4789 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:54.243" grpc.time_ms=0.663 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1867vm-test-run-nixbot-gitlab> gitlab # [  307.406635] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:54 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 868 "" "python-httpx/0.28.1" 571868vm-test-run-nixbot-gitlab> gitlab # [  307.410552] nixbot[3806]: {"ts": "2026-06-29T22:10:54.275Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}1869vm-test-run-nixbot-gitlab> gitlab # [  307.442205] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:54.308Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","d37e0a8fdb837bb47bfcf157da75dcaf302b1dcf 481ecae6ad30cb66776c9ca5211fb5c98e8800ee refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"aab7c6c10974e62da79d5790","created_at":"2026-06-29T22:10:54.302Z","trace_propagation_headers":{"sentry-trace":"5505d990429e43868265fbe6f26e3103-06d1288e0cc34e26","baggage":"sentry-trace_id=5505d990429e43868265fbe6f26e3103,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYWX1JYJ1JDA3913EASWD","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:54.304Z","job_size_bytes":185,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-aab7c6c10974e62da79d5790: start","job_status":"start","queue_duration_s":0.003441,"scheduling_latency_s":0.003479}1870vm-test-run-nixbot-gitlab> gitlab # [  307.480487] gitaly[1367]: time="2026-06-29T22:10:54.347Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01KWAPYWX1JYJ1JDA3913EASWD duration_ms=68ns method=POST pid=1367 status=200 url="http://unix/api/v4/internal/post_receive"1871vm-test-run-nixbot-gitlab> gitlab # [  307.485185] gitaly[1367]: time="2026-06-29T22:10:54.348Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4812 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:54.278" grpc.time_ms=69.793 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1872vm-test-run-nixbot-gitlab> gitlab # [  307.503736] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:54.349Z","message":"changes: \"d37e0a8fdb837bb47bfcf157da75dcaf302b1dcf 481ecae6ad30cb66776c9ca5211fb5c98e8800ee refs/heads/master\\n\""}1873vm-test-run-nixbot-gitlab> gitlab # [  307.509160] gitaly[1367]: time="2026-06-29T22:10:54.357Z" level=info msg="finished unary call with code OK" catfile.duration_ms=2 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=2 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=6 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=17 command.spawn_token_fork_ms=7 command.system_time_ms=0 command.user_time_ms=6 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYXPB2K4CDX19TZSXNJMW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-06-29T22:11:24.034" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=255 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:54.335" grpc.time_ms=21.608 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1874vm-test-run-nixbot-gitlab> gitlab # [  307.533017] gitaly[1367]: time="2026-06-29T22:10:54.369Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYXPB2K4CDX19TZSXNJMW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:24.069" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:54.369" grpc.time_ms=0.514 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1875vm-test-run-nixbot-gitlab> gitlab # To http://gitlab/root/test-flake.git1876vm-test-run-nixbot-gitlab> gitlab # [  307.548897] gitaly[1367]: time="2026-06-29T22:10:54.376Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD diskcache=e15f50ee-8950-480b-a76c-2fb21ae6008b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:53.608" pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1877vm-test-run-nixbot-gitlab> gitlab #    d37e0a8..481ecae  [  307.560533] gitlab-workhorse[1291]: time="2026-06-29T22:10:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521878vm-test-run-nixbot-gitlab> gitlab # master -> master[  307.562656] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:54 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.54.0" 9041879vm-test-run-nixbot-gitlab> gitlab # 1880vm-test-run-nixbot-gitlab> gitlab # [  307.565267] gitaly[1367]: time="2026-06-29T22:10:54.376Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=205 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=823296 command.minflt=12976 command.oublock=32 command.real_time_ms=757 command.spawn_token_fork_ms=2 command.system_time_ms=104 command.user_time_ms=101 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=605 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:53.608" grpc.time_ms=768.833 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1881vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: cd /tmp/test-flake && echo '# trigger' >> flake.nix && git add flake.nix && git commit -m 'trigger build' && git push origin master, in 1.34 seconds)1882vm-test-run-nixbot-gitlab> gitlab: must succeed: git -C /tmp/test-flake rev-parse master1883vm-test-run-nixbot-gitlab> gitlab # [  307.579741] gitaly[1367]: time="2026-06-29T22:10:54.380Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-29T22:11:04.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:54.369" grpc.time_ms=10.828 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1884vm-test-run-nixbot-gitlab> gitlab # [  307.593061] gitaly[1367]: time="2026-06-29T22:10:54.383Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=588 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYXPB2K4CDX19TZSXNJMW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-06-29T22:11:04.004" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:54.374" grpc.time_ms=9.06 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1885vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: git -C /tmp/test-flake rev-parse master, in 0.02 seconds)1886vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=481ecae6ad30cb66776c9ca5211fb5c98e8800ee'1887vm-test-run-nixbot-gitlab> gitlab # [  307.606602] gitaly[1367]: time="2026-06-29T22:10:54.393Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=576 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=0 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYXPB2K4CDX19TZSXNJMW grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-06-29T22:11:04.017" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:54.387" grpc.time_ms=6.418 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1888vm-test-run-nixbot-gitlab> gitlab # [  307.622283] nixbot[3806]: {"ts": "2026-06-29T22:10:54.469Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}1889vm-test-run-nixbot-gitlab> gitlab # [  307.625125] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 771 "" "python-httpx/0.28.1" 1841890vm-test-run-nixbot-gitlab> gitlab # [  307.627433] gitaly[1367]: time="2026-06-29T22:10:54.441Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=586 command.oublock=0 command.real_time_ms=8 command.spawn_token_fork_ms=7 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=FindLocalBranches grpc.request.deadline="2026-06-29T22:11:04.070" grpc.request.fullMethod=/gitaly.RefService/FindLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=266 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:54.430" grpc.time_ms=10.035 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1891vm-test-run-nixbot-gitlab> gitlab # [  307.641256] gitaly[1367]: time="2026-06-29T22:10:54.452Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=598 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=2 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommits grpc.request.deadline="2026-06-29T22:11:24.344" grpc.request.fullMethod=/gitaly.CommitService/ListCommits grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=212 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:54.444" grpc.time_ms=7.649 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1892vm-test-run-nixbot-gitlab> gitlab # [  307.657353] gitaly[1367]: time="2026-06-29T22:10:54.467Z" level=info msg="finished streaming call with code OK" command.count=1 command.cpu_time_ms=3 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=318 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=CommitDelta grpc.request.deadline="2026-06-29T22:11:04.100" grpc.request.fullMethod=/gitaly.DiffService/CommitDelta grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=116 grpc.service=gitaly.DiffService grpc.start_time="2026-06-29T22:10:54.461" grpc.time_ms=5.892 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1893vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=481ecae6ad30cb66776c9ca5211fb5c98e8800ee', in 0.07 seconds)1894vm-test-run-nixbot-gitlab> []1895vm-test-run-nixbot-gitlab> gitlab # [  307.671731] gitaly[1367]: time="2026-06-29T22:10:54.483Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-29T22:11:04.116" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:54.476" grpc.time_ms=7.417 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1896vm-test-run-nixbot-gitlab> gitlab # [  307.685851] nixbot[3806]: INFO:     ::ffff:127.0.0.1:43872 - "GET /api/repos/gitlab/root/test-flake/builds?commit=481ecae6ad30cb66776c9ca5211fb5c98e8800ee HTTP/1.1" 200 OK1897vm-test-run-nixbot-gitlab> gitlab # [  307.687974] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:54 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 781898vm-test-run-nixbot-gitlab> gitlab # [  307.690543] nixbot[3806]: {"ts": "2026-06-29T22:10:54.554Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}1899vm-test-run-nixbot-gitlab> gitlab # [  307.693315] nixbot[3806]: {"ts": "2026-06-29T22:10:54.556Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}1900vm-test-run-nixbot-gitlab> gitlab # [  307.791324] gitaly[1367]: time="2026-06-29T22:10:54.658Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=6 command.system_time_ms=6 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYY067MK57VHJGMAQY8FY grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:54.644" grpc.time_ms=13.75 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc1901vm-test-run-nixbot-gitlab> gitlab # [  307.804874] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 601902vm-test-run-nixbot-gitlab> gitlab # [  307.864700] gitaly[1367]: time="2026-06-29T22:10:54.732Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=FilterShasWithSignatures grpc.request.deadline="2026-06-29T22:11:04.010" grpc.request.fullMethod=/gitaly.CommitService/FilterShasWithSignatures grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:54.730" grpc.time_ms=1.161 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1903vm-test-run-nixbot-gitlab> gitlab # [  307.893251] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:54.757Z","retry":3,"queue":"default","version":0,"store":null,"args":["project-1","user-1","d37e0a8fdb837bb47bfcf157da75dcaf302b1dcf 481ecae6ad30cb66776c9ca5211fb5c98e8800ee refs/heads/master\n","{}","[FILTERED]"],"class":"Repositories::PostReceiveWorker","jid":"aab7c6c10974e62da79d5790","created_at":"2026-06-29T22:10:54.302Z","trace_propagation_headers":{"sentry-trace":"5505d990429e43868265fbe6f26e3103-06d1288e0cc34e26","baggage":"sentry-trace_id=5505d990429e43868265fbe6f26e3103,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYWX1JYJ1JDA3913EASWD","meta.caller_id":"POST /api/:version/internal/post_receive","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-06-29T22:10:54.304Z","job_size_bytes":185,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Repositories::PostReceiveWorker JID-aab7c6c10974e62da79d5790: done: 0.449856 sec","job_status":"done","queue_duration_s":0.003441,"scheduling_latency_s":0.003479,"gitaly_calls":6,"gitaly_duration_s":0.077867,"redis_calls":107,"redis_allowed_cross_slot_calls":4,"redis_duration_s":0.026299,"redis_read_bytes":365,"redis_write_bytes":12740,"redis_cache_calls":5,"redis_cache_duration_s":0.001108,"redis_cache_read_bytes":13,"redis_cache_write_bytes":347,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000469,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":323,"redis_queues_calls":8,"redis_queues_duration_s":0.001022,"redis_queues_read_bytes":8,"redis_queues_write_bytes":6768,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.003284,"redis_queues_metadata_read_bytes":11,"redis_queues_metadata_write_bytes":1182,"redis_repository_cache_calls":40,"redis_repository_cache_allowed_cross_slot_calls":4,"redis_repository_cache_duration_s":0.005295,"redis_repository_cache_read_bytes":192,"redis_repository_cache_write_bytes":2111,"redis_shared_state_calls":44,"redis_shared_state_duration_s":0.015121,"redis_shared_state_read_bytes":139,"redis_shared_state_write_bytes":2009,"db_count":28,"db_write_count":3,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":28,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.043,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":28,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":3,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.023,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.023,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.043,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.282639,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00061394,"exclusive_lock_hold_duration_s":0.04020728,"duration_s":0.449856,"completed_at":"2026-06-29T22:10:54.757Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.05822,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1904vm-test-run-nixbot-gitlab> gitlab # [  307.967483] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:54.760Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"9aca5f7bb1a7dc996579379b","created_at":"2026-06-29T22:10:54.404Z","trace_propagation_headers":{"sentry-trace":"5505d990429e43868265fbe6f26e3103-3647c87517eb48d8","baggage":"sentry-trace_id=5505d990429e43868265fbe6f26e3103,sentry-release=Unknown"},"correlation_id":"01KWAPYWX1JYJ1JDA3913EASWD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:54.407Z","job_size_bytes":46,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9aca5f7bb1a7dc996579379b: start","job_status":"start","queue_duration_s":0.353246,"scheduling_latency_s":0.35328}1905vm-test-run-nixbot-gitlab> gitlab # [  307.985818] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:54.802Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[]","[\"repository_size\", \"commit_count\"]","true"],"class":"ProjectCacheWorker","jid":"9aca5f7bb1a7dc996579379b","created_at":"2026-06-29T22:10:54.404Z","trace_propagation_headers":{"sentry-trace":"5505d990429e43868265fbe6f26e3103-3647c87517eb48d8","baggage":"sentry-trace_id=5505d990429e43868265fbe6f26e3103,sentry-release=Unknown"},"correlation_id":"01KWAPYWX1JYJ1JDA3913EASWD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6f67506c84ed98a5106f7d9419d8e0f06d78859d539bcf9f821535b1741756e6","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:54.407Z","job_size_bytes":46,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"ProjectCacheWorker JID-9aca5f7bb1a7dc996579379b: done: 0.041757 sec","job_status":"done","queue_duration_s":0.353246,"scheduling_latency_s":0.35328,"redis_calls":9,"redis_duration_s":0.0071319999999999995,"redis_read_bytes":23,"redis_write_bytes":782,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.004357,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":437,"redis_repository_cache_calls":1,"redis_repository_cache_duration_s":0.001509,"redis_repository_cache_read_bytes":18,"redis_repository_cache_write_bytes":41,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.001266,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":304,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.041757,"completed_at":"2026-06-29T22:10:54.802Z","load_balancing_strategy":"primary","db_duration_s":0.003865,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1906vm-test-run-nixbot-gitlab> gitlab # [  308.035011] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:54.804Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"9b784de93fbdf157675362db","created_at":"2026-06-29T22:10:54.424Z","trace_propagation_headers":{"sentry-trace":"5505d990429e43868265fbe6f26e3103-3647c87517eb48d8","baggage":"sentry-trace_id=5505d990429e43868265fbe6f26e3103,sentry-release=Unknown"},"correlation_id":"01KWAPYWX1JYJ1JDA3913EASWD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:54.427Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-9b784de93fbdf157675362db: start","job_status":"start","queue_duration_s":0.37684,"scheduling_latency_s":0.376863}1907vm-test-run-nixbot-gitlab> gitlab # [  308.052648] gitaly[1367]: time="2026-06-29T22:10:54.784Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYY25FN4QCA9T4ZZAYTX7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:54.774" pid=1367 remote_ip="2001:db8:1::1" request_sha=083c43590fffa527704b32b8836424e8ed055017 response_bytes=149 span.kind=server system=grpc1908vm-test-run-nixbot-gitlab> gitlab # [  308.062947] gitlab-workhorse[1291]: time="2026-06-29T22:10:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1491909vm-test-run-nixbot-gitlab> gitlab # [  308.064891] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 149 "" "git/2.54.0" 1261910vm-test-run-nixbot-gitlab> gitlab # [  308.066802] gitlab-workhorse[1291]: time="2026-06-29T22:10:54Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=5971911vm-test-run-nixbot-gitlab> gitlab # [  308.068741] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:54 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 597 "" "git/2.54.0" 1011912vm-test-run-nixbot-gitlab> gitlab # [  308.070707] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:54.873Z","retry":1,"queue":"default","version":0,"store":null,"backtrace":5,"args":["1"],"class":"DetectRepositoryLanguagesWorker","jid":"9b784de93fbdf157675362db","created_at":"2026-06-29T22:10:54.424Z","trace_propagation_headers":{"sentry-trace":"5505d990429e43868265fbe6f26e3103-3647c87517eb48d8","baggage":"sentry-trace_id=5505d990429e43868265fbe6f26e3103,sentry-release=Unknown"},"correlation_id":"01KWAPYWX1JYJ1JDA3913EASWD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"source_code_management","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:6013123ea9f6f8092f8eb4cb733d3949fa1e39a27e7ad74ad4f54a7c23d87776","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:54.427Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"DetectRepositoryLanguagesWorker JID-9b784de93fbdf157675362db: done: 0.070018 sec","job_status":"done","queue_duration_s":0.37684,"scheduling_latency_s":0.376863,"gitaly_calls":1,"gitaly_duration_s":0.032972,"redis_calls":12,"redis_duration_s":0.001944,"redis_read_bytes":64,"redis_write_bytes":1136,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000833,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":479,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000375,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000736,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":520,"db_count":8,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":8,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":8,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.006,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.006,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.029264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.04852884,"duration_s":0.070018,"completed_at":"2026-06-29T22:10:54.873Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004523,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1913vm-test-run-nixbot-gitlab> gitlab # [  308.116427] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:54.877Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c23662bf590911a3d68f84a1","created_at":"2026-06-29T22:10:54.537Z","trace_propagation_headers":{"sentry-trace":"5505d990429e43868265fbe6f26e3103-3647c87517eb48d8","baggage":"sentry-trace_id=5505d990429e43868265fbe6f26e3103,sentry-release=Unknown"},"correlation_id":"01KWAPYWX1JYJ1JDA3913EASWD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9ef4e8529011584e51228ea80fa86f50db77996802683bb948a2704c2b0eea29","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:54.539Z","job_size_bytes":467,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c23662bf590911a3d68f84a1: start","job_status":"start","queue_duration_s":0.337716,"scheduling_latency_s":0.337735}1914vm-test-run-nixbot-gitlab> gitlab # [  308.133935] gitaly[1367]: time="2026-06-29T22:10:54.784Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYY25FN4QCA9T4ZZAYTX7 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:54.774" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc1915vm-test-run-nixbot-gitlab> gitlab # [  308.147642] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:54 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.54.0" 651916vm-test-run-nixbot-gitlab> gitlab # [  308.150042] gitaly[1367]: time="2026-06-29T22:10:54.785Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=5 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=3 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYY25FN4QCA9T4ZZAYTX7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:54.774" grpc.time_ms=10.59 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc1917vm-test-run-nixbot-gitlab> gitlab # [  308.164682] gitaly[1367]: time="2026-06-29T22:10:54.856Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD diskcache=fb66ccac-bfe8-4779-903a-e8675b058620 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-30T04:10:54.825" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:54.826" pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1918vm-test-run-nixbot-gitlab> gitlab # [  308.174726] gitaly[1367]: time="2026-06-29T22:10:54.856Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=5 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1510 command.oublock=0 command.real_time_ms=34 command.spawn_token_fork_ms=7 command.system_time_ms=6 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitLanguages grpc.request.deadline="2026-06-30T04:10:54.825" grpc.request.fullMethod=/gitaly.CommitService/CommitLanguages grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=27 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:54.826" grpc.time_ms=29.917 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1919vm-test-run-nixbot-gitlab> gitlab # [  308.190470] gitaly[1367]: time="2026-06-29T22:10:54.892Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYY68KN50YRAXQC39RMK5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:54.874" pid=1367 remote_ip="2001:db8:1::1" request_sha=58a6225c3f305e3faa31b74a133b177da335d62a response_bytes=597 span.kind=server system=grpc1920vm-test-run-nixbot-gitlab> gitlab # [  308.200824] gitaly[1367]: time="2026-06-29T22:10:54.892Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1139 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYY68KN50YRAXQC39RMK5 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:54.874" negotiation.command=fetch negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc1921vm-test-run-nixbot-gitlab> gitlab # [  308.214331] gitlab-workhorse[1291]: time="2026-06-29T22:10:55Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=671922vm-test-run-nixbot-gitlab> gitlab # [  308.223109] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:55 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.54.0" 641923vm-test-run-nixbot-gitlab> gitlab # [  308.225245] gitaly[1367]: time="2026-06-29T22:10:54.892Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1139 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYY68KN50YRAXQC39RMK5 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=9 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:54.874" grpc.time_ms=17.953 negotiation.command=fetch negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=2 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc1924vm-test-run-nixbot-gitlab> gitlab # [  308.241182] gitaly[1367]: time="2026-06-29T22:10:54.903Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:24.802" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:54.902" grpc.time_ms=0.458 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1925vm-test-run-nixbot-gitlab> gitlab # [  308.253887] gitaly[1367]: time="2026-06-29T22:10:54.911Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=5 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-29T22:11:04.105" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=142 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:54.905" grpc.time_ms=6.583 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1926vm-test-run-nixbot-gitlab> gitlab # [  308.267193] gitaly[1367]: time="2026-06-29T22:10:54.948Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-29T22:11:24.846" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:54.946" grpc.time_ms=0.828 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1927vm-test-run-nixbot-gitlab> gitlab # [  308.280349] gitaly[1367]: time="2026-06-29T22:10:54.953Z" level=info msg="finished streaming call with code NotFound" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=1 command.cpu_time_ms=1 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=69 command.oublock=0 command.real_time_ms=1 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=1 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD error="tree entry not found" error_metadata="map[path:.gitlab-ci.yml]" grpc.code=NotFound grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=TreeEntry grpc.request.deadline="2026-06-29T22:11:24.851" grpc.request.fullMethod=/gitaly.CommitService/TreeEntry grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=186 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:54.951" grpc.time_ms=2.08 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1928vm-test-run-nixbot-gitlab> gitlab # [  308.296514] gitaly[1367]: time="2026-06-29T22:10:54.993Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=1 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYYAF3GYG4JPCVA3AYWXV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=187 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:54.985" grpc.time_ms=7.734 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc1929vm-test-run-nixbot-gitlab> gitlab # [  308.310012] gitaly[1367]: time="2026-06-29T22:10:55.001Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=4 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-29T22:11:04.195" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:54.995" grpc.time_ms=5.888 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1930vm-test-run-nixbot-gitlab> gitlab # [  308.324263] gitaly[1367]: time="2026-06-29T22:10:55.058Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYYCJMQHT3ZBGHHEEGXBA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:55.049" pid=1367 remote_ip="2001:db8:1::1" request_sha=cc69fbe136984084848b4359b2caac0b76309173 response_bytes=67 span.kind=server system=grpc1931vm-test-run-nixbot-gitlab> gitlab # [  308.334807] gitaly[1367]: time="2026-06-29T22:10:55.058Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYYCJMQHT3ZBGHHEEGXBA grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:55.049" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc1932vm-test-run-nixbot-gitlab> gitlab # [  308.348905] gitaly[1367]: time="2026-06-29T22:10:55.058Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=7 command.spawn_token_fork_ms=5 command.system_time_ms=2 command.user_time_ms=2 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYYCJMQHT3ZBGHHEEGXBA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-06-29T22:10:55.049" grpc.time_ms=9.198 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.54.0-Linux negotiation.wants=0 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc1933vm-test-run-nixbot-gitlab> gitlab # [  308.363469] gitaly[1367]: time="2026-06-29T22:10:55.144Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYYFN5TH3WGRGT3CSRS8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:25.043" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:55.143" grpc.time_ms=0.564 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1934vm-test-run-nixbot-gitlab> gitlab # [  308.376933] gitaly[1367]: time="2026-06-29T22:10:55.193Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=593 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYYFN5TH3WGRGT3CSRS8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-06-29T22:11:25.079" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:55.179" grpc.time_ms=13.585 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1935vm-test-run-nixbot-gitlab> gitlab # [  308.391641] gitaly[1367]: time="2026-06-29T22:10:55.215Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYYFN5TH3WGRGT3CSRS8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-29T22:11:05.151" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:55.202" grpc.time_ms=12.806 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1936vm-test-run-nixbot-gitlab> gitlab # [  308.410251] gitaly[1367]: time="2026-06-29T22:10:55.277Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYYFN5TH3WGRGT3CSRS8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-06-29T22:11:05.226" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:55.277" grpc.time_ms=0.402 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1937vm-test-run-nixbot-gitlab> gitlab # [  308.432667] gitaly[1367]: time="2026-06-29T22:10:55.300Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=0 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYYFN5TH3WGRGT3CSRS8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-06-29T22:11:05.234" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:10:55.285" grpc.time_ms=14.92 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1938vm-test-run-nixbot-gitlab> gitlab # [  308.483464] gitaly[1367]: time="2026-06-29T22:10:55.351Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYYFN5TH3WGRGT3CSRS8D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4155 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:55.350" grpc.time_ms=0.495 pid=1367 span.kind=server system=grpc1939vm-test-run-nixbot-gitlab> gitlab # [  308.514283] gitaly[1367]: time="2026-06-29T22:10:55.381Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPYYFN5TH3WGRGT3CSRS8D grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4157 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:10:55.380" grpc.time_ms=1.795 pid=1367 span.kind=server system=grpc1940vm-test-run-nixbot-gitlab> gitlab # [  308.530391] gitaly[1367]: time="2026-06-29T22:10:55.392Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYYFN5TH3WGRGT3CSRS8D diskcache=cef457ae-6996-47ff-9dd5-d9f179e7f210 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-29T22:11:05.252" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:55.302" pid=1367 ref=refs/keep-around/481ecae6ad30cb66776c9ca5211fb5c98e8800ee remote_ip="2001:db8:1::1" revision=481ecae6ad30cb66776c9ca5211fb5c98e8800ee span.kind=server system=grpc username=root1941vm-test-run-nixbot-gitlab> gitlab # [  308.547107] gitaly[1367]: time="2026-06-29T22:10:55.393Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=83 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5005 command.oublock=8 command.real_time_ms=84 command.spawn_token_fork_ms=0 command.system_time_ms=50 command.user_time_ms=33 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYYFN5TH3WGRGT3CSRS8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-06-29T22:11:05.252" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-06-29T22:10:55.302" grpc.time_ms=90.639 pid=1367 ref=refs/keep-around/481ecae6ad30cb66776c9ca5211fb5c98e8800ee remote_ip="2001:db8:1::1" revision=481ecae6ad30cb66776c9ca5211fb5c98e8800ee span.kind=server system=grpc username=root1942vm-test-run-nixbot-gitlab> gitlab # [  308.565597] gitaly[1367]: time="2026-06-29T22:10:55.397Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYYFN5TH3WGRGT3CSRS8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:25.196" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:55.396" grpc.time_ms=0.529 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1943vm-test-run-nixbot-gitlab> gitlab: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=481ecae6ad30cb66776c9ca5211fb5c98e8800ee'1944vm-test-run-nixbot-gitlab> gitlab # [  308.719177] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:55 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/481ecae6ad30cb66776c9ca5211fb5c98e8800ee HTTP/1.1" 201 631 "" "python-httpx/0.28.1" 4921945vm-test-run-nixbot-gitlab> gitlab # [  308.722493] nixbot[3806]: {"ts": "2026-06-29T22:10:55.588Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/481ecae6ad30cb66776c9ca5211fb5c98e8800ee \"HTTP/1.1 201 Created\""}1946vm-test-run-nixbot-gitlab> gitlab # [  308.736597] nixbot[3806]: INFO:     ::ffff:127.0.0.1:43876 - "GET /api/repos/gitlab/root/test-flake/builds?commit=481ecae6ad30cb66776c9ca5211fb5c98e8800ee HTTP/1.1" 200 OK1947vm-test-run-nixbot-gitlab> gitlab # [  308.738970] nixbot[3806]: {"ts": "2026-06-29T22:10:55.605Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-481ecae6ad30-8a89ae34", "argv0": "bwrap"}1948vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: curl --fail -s 'http://127.0.0.1:8010/api/repos/gitlab/root/test-flake/builds?commit=481ecae6ad30cb66776c9ca5211fb5c98e8800ee', in 0.07 seconds)1949vm-test-run-nixbot-gitlab> [{'id': 1, 'project_id': 1, 'number': 1, 'tree_hash': 'cefc112e8680bb0f9569544b9656644ac3312d93', 'commit_sha': '481ecae6ad30cb66776c9ca5211fb5c98e8800ee', 'branch': 'master', 'pr_number': None, 'pr_author': None, 'status': 'evaluating', 'eval_warnings': None, 'error': None, 'created_at': '2026-06-29T22:10:55.081199Z', 'started_at': '2026-06-29T22:10:55.596913Z', 'finished_at': None}]1950vm-test-run-nixbot-gitlab> (finished: subtest: push delivers the webhook, in 2.49 seconds)1951vm-test-run-nixbot-gitlab> subtest: eval and build post commit statuses1952vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses1953vm-test-run-nixbot-gitlab> gitlab # [  308.852736] gitaly[1367]: time="2026-06-29T22:10:55.720Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYZ187HTA3SF2Z506VYEC grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:25.118" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:55.719" grpc.time_ms=1.066 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1954vm-test-run-nixbot-gitlab> gitlab # [  308.872463] systemd[1]: Started Nix Daemon.1955vm-test-run-nixbot-gitlab> gitlab # [  308.948563] nix-daemon[4101]: accepted connection from pid 4100, user nixbot1956vm-test-run-nixbot-gitlab> gitlab # [  308.953036] nix-daemon[4101]: accepted connection from pid 4099, user nixbot1957vm-test-run-nixbot-gitlab> gitlab # [  309.043418] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:55 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 2531958vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses, in 0.30 seconds)1959vm-test-run-nixbot-gitlab> [{'id': 1, 'sha': '481ecae6ad30cb66776c9ca5211fb5c98e8800ee', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-06-29T22:10:55.544Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1960vm-test-run-nixbot-gitlab> gitlab # [  309.051692] gitaly[1367]: time="2026-06-29T22:10:55.919Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_info_count=1 catfile.read_info_ms=0 catfile.request_info_count=1 catfile.request_info_ms=0 command.count=3 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=883 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=1 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=GetTreeEntries grpc.request.deadline="2026-06-29T22:11:25.799" grpc.request.fullMethod=/gitaly.CommitService/GetTreeEntries grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=178 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=103 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:55.899" grpc.time_ms=19.426 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1961vm-test-run-nixbot-gitlab> gitlab # [  309.077596] gitaly[1367]: time="2026-06-29T22:10:55.935Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=3 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYWX1JYJ1JDA3913EASWD grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListFiles grpc.request.deadline="2026-06-29T22:11:25.821" grpc.request.fullMethod=/gitaly.CommitService/ListFiles grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=11 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:55.922" grpc.time_ms=13.266 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1962vm-test-run-nixbot-gitlab> gitlab # [  309.097581] sidekiq-cluster[2440]: {"severity":"WARN","time":"2026-06-29T22:10:55.952Z","class":"CreatePipelineWorker","correlation_id":"01KWAPYWX1JYJ1JDA3913EASWD","project_id":1,"project_path":"root/test-flake","message":"Error creating pipeline","errors":"The pipeline did not run. Review the workflow:rules configuration for the pipeline.","pipeline_params":{"before":"d37e0a8fdb837bb47bfcf157da75dcaf302b1dcf","after":"481ecae6ad30cb66776c9ca5211fb5c98e8800ee","variables_attributes":[],"gitaly_context":{"glBuildId":"","scoped-user-id":""},"checkout_sha":"481ecae6ad30cb66776c9ca5211fb5c98e8800ee","ref":"refs/heads/master"},"retry":0}1963vm-test-run-nixbot-gitlab> gitlab # [  309.106821] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:55.957Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_creation","args":["1","1","refs/heads/master","push","{\"inputs\"=\u003e{}}","[FILTERED]"],"class":"CreatePipelineWorker","jid":"c23662bf590911a3d68f84a1","created_at":"2026-06-29T22:10:54.537Z","trace_propagation_headers":{"sentry-trace":"5505d990429e43868265fbe6f26e3103-3647c87517eb48d8","baggage":"sentry-trace_id=5505d990429e43868265fbe6f26e3103,sentry-release=Unknown"},"correlation_id":"01KWAPYWX1JYJ1JDA3913EASWD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"pipeline_composition","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:9ef4e8529011584e51228ea80fa86f50db77996802683bb948a2704c2b0eea29","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:54.539Z","job_size_bytes":467,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"CreatePipelineWorker JID-c23662bf590911a3d68f84a1: done: 1.080939 sec","job_status":"done","queue_duration_s":0.337716,"scheduling_latency_s":0.337735,"gitaly_calls":7,"gitaly_duration_s":0.064015,"redis_calls":33,"redis_duration_s":0.0076749999999999995,"redis_read_bytes":186,"redis_write_bytes":1839,"redis_cache_calls":3,"redis_cache_duration_s":0.003744,"redis_cache_read_bytes":45,"redis_cache_write_bytes":255,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000878,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":443,"redis_repository_cache_calls":19,"redis_repository_cache_duration_s":0.002293,"redis_repository_cache_read_bytes":120,"redis_repository_cache_write_bytes":628,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00076,"redis_shared_state_read_bytes":17,"redis_shared_state_write_bytes":513,"db_count":30,"db_write_count":0,"db_cached_count":1,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":30,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.368,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":26,"db_ci_count":4,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.364,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.781809,"worker_id":"sidekiq_0","rate_limiting_gates":["pipelines_create","pipelines_created_per_user"],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":1.080939,"completed_at":"2026-06-29T22:10:55.957Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.367645,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1964vm-test-run-nixbot-gitlab> gitlab # [  309.157975] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:55.959Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{\"idempotency_key\"=\u003e\"c01237de-7c30-4e87-a516-36021af13c2d\"}"],"class":"WebHookWorker","jid":"51ca403ad98ff50b381ff7e2","created_at":"2026-06-29T22:10:54.705Z","trace_propagation_headers":{"sentry-trace":"5505d990429e43868265fbe6f26e3103-3647c87517eb48d8","baggage":"sentry-trace_id=5505d990429e43868265fbe6f26e3103,sentry-release=Unknown"},"correlation_id":"01KWAPYWX1JYJ1JDA3913EASWD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1d069cf5aec34a1534662c00f1d7da4c373401cc3565eda7a956c5609be01764","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:54.712Z","job_size_bytes":1749,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-51ca403ad98ff50b381ff7e2: start","job_status":"start","queue_duration_s":1.247063,"scheduling_latency_s":1.247115}1965vm-test-run-nixbot-gitlab> gitlab # [  309.189642] nixbot[3806]: INFO:     ::ffff:127.0.0.1:43884 - "POST /webhooks/gitlab HTTP/1.1" 202 Accepted1966vm-test-run-nixbot-gitlab> gitlab # [  309.208686] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:56.075Z","retry":4,"queue":"default","version":0,"store":null,"dead":false,"args":["1","[FILTERED]","push_hooks","{:idempotency_key=\u003e\"c01237de-7c30-4e87-a516-36021af13c2d\"}"],"class":"WebHookWorker","jid":"51ca403ad98ff50b381ff7e2","created_at":"2026-06-29T22:10:54.705Z","trace_propagation_headers":{"sentry-trace":"5505d990429e43868265fbe6f26e3103-3647c87517eb48d8","baggage":"sentry-trace_id=5505d990429e43868265fbe6f26e3103,sentry-release=Unknown"},"correlation_id":"01KWAPYWX1JYJ1JDA3913EASWD","meta.caller_id":"Repositories::PostReceiveWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1d069cf5aec34a1534662c00f1d7da4c373401cc3565eda7a956c5609be01764","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:54.712Z","job_size_bytes":1749,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHookWorker JID-51ca403ad98ff50b381ff7e2: done: 0.116054 sec","job_status":"done","queue_duration_s":1.247063,"scheduling_latency_s":1.247115,"redis_calls":19,"redis_duration_s":0.004242,"redis_read_bytes":31,"redis_write_bytes":5281,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001183,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":622,"redis_queues_calls":2,"redis_queues_duration_s":0.000429,"redis_queues_read_bytes":2,"redis_queues_write_bytes":3643,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.001744,"redis_queues_metadata_read_bytes":6,"redis_queues_metadata_write_bytes":690,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000886,"redis_shared_state_read_bytes":19,"redis_shared_state_write_bytes":326,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"external_http_count":1,"external_http_duration_s":0.013853799999992589,"cpu_s":0.087771,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033842,"extra.web_hook_worker.response_status":"success","extra.web_hook_worker.http_status":"ok","duration_s":0.116054,"completed_at":"2026-06-29T22:10:56.075Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.003953,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1967vm-test-run-nixbot-gitlab> gitlab # [  309.260954] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:56.077Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ee15c57ebbce38421e2981fb","created_at":"2026-06-29T22:10:55.401Z","trace_propagation_headers":{"sentry-trace":"69ebb08f058c4e87935ecc23b23a1ca5-7cfdf29116fa461b","baggage":"sentry-trace_id=69ebb08f058c4e87935ecc23b23a1ca5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYYFN5TH3WGRGT3CSRS8D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:55.408Z","job_size_bytes":65,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ee15c57ebbce38421e2981fb: start","job_status":"start","queue_duration_s":0.669259,"scheduling_latency_s":0.66928}1968vm-test-run-nixbot-gitlab> gitlab # [  309.278412] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:56.145Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"MergeRequests::UpdateHeadPipelineWorker","jid":"ee15c57ebbce38421e2981fb","created_at":"2026-06-29T22:10:55.401Z","trace_propagation_headers":{"sentry-trace":"69ebb08f058c4e87935ecc23b23a1ca5-7cfdf29116fa461b","baggage":"sentry-trace_id=69ebb08f058c4e87935ecc23b23a1ca5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYYFN5TH3WGRGT3CSRS8D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_review_workflow","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:efbbb938170501c99cc41a8a2b4ae8ea32bc3fc95221eec9a69e494b4dc14b10","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:55.408Z","job_size_bytes":65,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::UpdateHeadPipelineWorker JID-ee15c57ebbce38421e2981fb: done: 0.068093 sec","job_status":"done","queue_duration_s":0.669259,"scheduling_latency_s":0.66928,"redis_calls":18,"redis_duration_s":0.004815,"redis_read_bytes":271,"redis_write_bytes":2103,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.002642,"redis_feature_flag_read_bytes":264,"redis_feature_flag_write_bytes":1285,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001582,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":590,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000591,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":228,"db_count":7,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.013,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037698,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00044824,"duration_s":0.068093,"completed_at":"2026-06-29T22:10:56.145Z","load_balancing_strategy":"primary","db_duration_s":0.021812,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1969vm-test-run-nixbot-gitlab> gitlab # [  309.325016] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:56.147Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0a7ac39c95dd356d63c43cc5","created_at":"2026-06-29T22:10:55.409Z","trace_propagation_headers":{"sentry-trace":"69ebb08f058c4e87935ecc23b23a1ca5-7cfdf29116fa461b","baggage":"sentry-trace_id=69ebb08f058c4e87935ecc23b23a1ca5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYYFN5TH3WGRGT3CSRS8D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:55.414Z","job_size_bytes":65,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0a7ac39c95dd356d63c43cc5: start","job_status":"start","queue_duration_s":0.733658,"scheduling_latency_s":0.733675}1970vm-test-run-nixbot-gitlab> gitlab # [  309.375412] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:56.242Z","retry":25,"queue":"default","version":0,"store":null,"args":["Ci::PipelineCreatedEvent","{\"pipeline_id\"=\u003e1, \"partition_id\"=\u003e100}"],"class":"Ci::TrackPipelineTriggerEventsWorker","jid":"0a7ac39c95dd356d63c43cc5","created_at":"2026-06-29T22:10:55.409Z","trace_propagation_headers":{"sentry-trace":"69ebb08f058c4e87935ecc23b23a1ca5-7cfdf29116fa461b","baggage":"sentry-trace_id=69ebb08f058c4e87935ecc23b23a1ca5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYYFN5TH3WGRGT3CSRS8D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:98ff20ecdaa20afd17480d536c184377f85c5a4d32875b1023fc943dfe20026b","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:55.414Z","job_size_bytes":65,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::TrackPipelineTriggerEventsWorker JID-0a7ac39c95dd356d63c43cc5: done: 0.094707 sec","job_status":"done","queue_duration_s":0.733658,"scheduling_latency_s":0.733675,"redis_calls":21,"redis_duration_s":0.006012,"redis_read_bytes":148,"redis_write_bytes":2264,"redis_feature_flag_calls":9,"redis_feature_flag_duration_s":0.002652,"redis_feature_flag_read_bytes":136,"redis_feature_flag_write_bytes":1264,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00163,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":578,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00173,"redis_shared_state_read_bytes":8,"redis_shared_state_write_bytes":422,"db_count":12,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":10,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.023,"db_ci_duration_s":0.003,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.057236,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00043958,"duration_s":0.094707,"completed_at":"2026-06-29T22:10:56.242Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.027154,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1971vm-test-run-nixbot-gitlab> gitlab # [  309.426779] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:56.244Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"889a0af6ebd1f59e225cea81","created_at":"2026-06-29T22:10:55.558Z","trace_propagation_headers":{"sentry-trace":"69ebb08f058c4e87935ecc23b23a1ca5-7cfdf29116fa461b","baggage":"sentry-trace_id=69ebb08f058c4e87935ecc23b23a1ca5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYYFN5TH3WGRGT3CSRS8D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:55.565Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-889a0af6ebd1f59e225cea81: start","job_status":"start","queue_duration_s":0.678749,"scheduling_latency_s":0.678765}1972vm-test-run-nixbot-gitlab> gitlab # [  309.486810] gitaly[1367]: time="2026-06-29T22:10:56.354Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPYYFN5TH3WGRGT3CSRS8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-29T22:11:26.252" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:56.353" grpc.time_ms=1.187 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1973vm-test-run-nixbot-gitlab> gitlab # [  309.547481] gitaly[1367]: time="2026-06-29T22:10:56.414Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYYFN5TH3WGRGT3CSRS8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:26.313" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:56.413" grpc.time_ms=1.082 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1974vm-test-run-nixbot-gitlab> gitlab # [  309.594072] gitaly[1367]: time="2026-06-29T22:10:56.460Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPYYFN5TH3WGRGT3CSRS8D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:26.358" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:56.459" grpc.time_ms=1.269 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1975vm-test-run-nixbot-gitlab> gitlab # [  309.629440] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:56.478Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"889a0af6ebd1f59e225cea81","created_at":"2026-06-29T22:10:55.558Z","trace_propagation_headers":{"sentry-trace":"69ebb08f058c4e87935ecc23b23a1ca5-7cfdf29116fa461b","baggage":"sentry-trace_id=69ebb08f058c4e87935ecc23b23a1ca5,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPYYFN5TH3WGRGT3CSRS8D","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:55.565Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-889a0af6ebd1f59e225cea81: done: 0.233941 sec","job_status":"done","queue_duration_s":0.678749,"scheduling_latency_s":0.678765,"gitaly_calls":3,"gitaly_duration_s":0.011977,"redis_calls":53,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.014183000000000001,"redis_read_bytes":235,"redis_write_bytes":7158,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001474,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":20,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.004257,"redis_cache_read_bytes":38,"redis_cache_write_bytes":1784,"redis_feature_flag_calls":7,"redis_feature_flag_duration_s":0.001769,"redis_feature_flag_read_bytes":134,"redis_feature_flag_write_bytes":992,"redis_queues_calls":2,"redis_queues_duration_s":0.000378,"redis_queues_read_bytes":2,"redis_queues_write_bytes":1133,"redis_queues_metadata_calls":8,"redis_queues_metadata_duration_s":0.002327,"redis_queues_metadata_read_bytes":7,"redis_queues_metadata_write_bytes":840,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000552,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":165,"redis_repository_cache_calls":2,"redis_repository_cache_duration_s":0.000718,"redis_repository_cache_read_bytes":39,"redis_repository_cache_write_bytes":83,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001234,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":551,"db_count":34,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":34,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.05,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":22,"db_ci_count":12,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.004,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.008,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.028,"db_ci_duration_s":0.022,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.164023,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.19632476000000001,"duration_s":0.233941,"completed_at":"2026-06-29T22:10:56.478Z","load_balancing_strategy":"primary","db_duration_s":0.057109,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1976vm-test-run-nixbot-gitlab> gitlab # [  309.706700] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:56.480Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","51ca403ad98ff50b381ff7e2"],"class":"WebHooks::LogExecutionWorker","jid":"abaf213e7729e7a29e729e3d","created_at":"2026-06-29T22:10:56.059Z","trace_propagation_headers":{"sentry-trace":"5505d990429e43868265fbe6f26e3103-a700ec2cef5c4578","baggage":"sentry-trace_id=5505d990429e43868265fbe6f26e3103,sentry-release=Unknown"},"correlation_id":"01KWAPYWX1JYJ1JDA3913EASWD","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d5ffd47999e43937186efa5841471938c856d9b6d99d7104d0a255095003b68d","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:56.066Z","job_size_bytes":2506,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-abaf213e7729e7a29e729e3d: start","job_status":"start","queue_duration_s":0.413903,"scheduling_latency_s":0.413926}1977vm-test-run-nixbot-gitlab> gitlab # [  309.765281] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:56.632Z","retry":3,"queue":"default","version":0,"store":null,"args":["1","[FILTERED]","ok","51ca403ad98ff50b381ff7e2"],"class":"WebHooks::LogExecutionWorker","jid":"abaf213e7729e7a29e729e3d","created_at":"2026-06-29T22:10:56.059Z","trace_propagation_headers":{"sentry-trace":"5505d990429e43868265fbe6f26e3103-a700ec2cef5c4578","baggage":"sentry-trace_id=5505d990429e43868265fbe6f26e3103,sentry-release=Unknown"},"correlation_id":"01KWAPYWX1JYJ1JDA3913EASWD","meta.caller_id":"WebHookWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"webhooks","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.organization_id":1,"meta.root_caller_id":"POST /api/:version/internal/post_receive","meta.related_class":"ProjectHook","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:d5ffd47999e43937186efa5841471938c856d9b6d99d7104d0a255095003b68d","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:56.066Z","job_size_bytes":2506,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"WebHooks::LogExecutionWorker JID-abaf213e7729e7a29e729e3d: done: 0.151843 sec","job_status":"done","queue_duration_s":0.413903,"scheduling_latency_s":0.413926,"redis_calls":10,"redis_duration_s":0.002618,"redis_read_bytes":9,"redis_write_bytes":1045,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000474,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":299,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001575,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":542,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000569,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":204,"db_count":4,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.036,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.036,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.008,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.130817,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00035002,"duration_s":0.151843,"completed_at":"2026-06-29T22:10:56.632Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012397,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1978vm-test-run-nixbot-gitlab> gitlab # [  309.828957] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:56.633Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"a5d170c4d48839599d7b0908","created_at":"2026-06-29T22:10:56.332Z","trace_propagation_headers":{"sentry-trace":"69ebb08f058c4e87935ecc23b23a1ca5-95cb1f48d34c4973","baggage":"sentry-trace_id=69ebb08f058c4e87935ecc23b23a1ca5,sentry-release=Unknown"},"correlation_id":"01KWAPYYFN5TH3WGRGT3CSRS8D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:56.337Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a5d170c4d48839599d7b0908: start","job_status":"start","queue_duration_s":0.296836,"scheduling_latency_s":0.296851}1979vm-test-run-nixbot-gitlab> gitlab # [  309.846704] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:10:56.673Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_hooks","args":["1"],"class":"PipelineHooksWorker","jid":"a5d170c4d48839599d7b0908","created_at":"2026-06-29T22:10:56.332Z","trace_propagation_headers":{"sentry-trace":"69ebb08f058c4e87935ecc23b23a1ca5-95cb1f48d34c4973","baggage":"sentry-trace_id=69ebb08f058c4e87935ecc23b23a1ca5,sentry-release=Unknown"},"correlation_id":"01KWAPYYFN5TH3WGRGT3CSRS8D","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7edae2f9320b4a04c72581c654fa0bced58f6822c07b16acc3b7bbc1333d0281","size_limiter":"validated","enqueued_at":"2026-06-29T22:10:56.337Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineHooksWorker JID-a5d170c4d48839599d7b0908: done: 0.03992 sec","job_status":"done","queue_duration_s":0.296836,"scheduling_latency_s":0.296851,"redis_calls":10,"redis_duration_s":0.003502,"redis_read_bytes":9,"redis_write_bytes":973,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000523,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":281,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002428,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":506,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000551,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":186,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.025703,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0004427,"duration_s":0.03992,"completed_at":"2026-06-29T22:10:56.673Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006951,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1980vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses1981vm-test-run-nixbot-gitlab> gitlab # [  310.227083] gitaly[1367]: time="2026-06-29T22:10:57.094Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPZ0ARAYPWWG9A3CKBMD3R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:27.092" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:57.092" grpc.time_ms=1.218 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1982vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses, in 0.25 seconds)1983vm-test-run-nixbot-gitlab> [{'id': 1, 'sha': '481ecae6ad30cb66776c9ca5211fb5c98e8800ee', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-06-29T22:10:55.544Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1984vm-test-run-nixbot-gitlab> gitlab # [  310.291716] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:57 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1731985vm-test-run-nixbot-gitlab> gitlab # [  311.196206] redis[1256]: 10 changes in 300 seconds. Saving...1986vm-test-run-nixbot-gitlab> gitlab # [  311.196578] redis[1256]: Background saving started by pid 41301987vm-test-run-nixbot-gitlab> gitlab # [  311.207531] redis[4130]: BGSAVE done, 551 keys saved, 0 keys skipped, 131270 bytes written.1988vm-test-run-nixbot-gitlab> gitlab # [  311.212795] redis[4130]: DB saved on disk1989vm-test-run-nixbot-gitlab> gitlab # [  311.215037] redis[4130]: Fork CoW for RDB: current 0 MB, peak 0 MB, average 0 MB1990vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses1991vm-test-run-nixbot-gitlab> gitlab # [  311.297278] redis[1256]: Background saving terminated with success1992vm-test-run-nixbot-gitlab> gitlab # [  311.442923] gitaly[1367]: time="2026-06-29T22:10:58.309Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPZ1H5NDFPKG7M6K7P8HK2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:28.307" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:58.307" grpc.time_ms=1.208 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1993vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses, in 0.20 seconds)1994vm-test-run-nixbot-gitlab> [{'id': 1, 'sha': '481ecae6ad30cb66776c9ca5211fb5c98e8800ee', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-06-29T22:10:55.544Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]1995vm-test-run-nixbot-gitlab> gitlab # [  311.489240] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:58 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1411996vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses1997vm-test-run-nixbot-gitlab> gitlab # [  312.608633] postgres[1329]: [1329] LOG:  checkpoint starting: time1998vm-test-run-nixbot-gitlab> gitlab # [  312.645801] gitaly[1367]: time="2026-06-29T22:10:59.512Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPZ2PJ6XNKKMAH103WQ0JF grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:29.210" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:10:59.510" grpc.time_ms=1.267 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1999vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses, in 0.21 seconds)2000vm-test-run-nixbot-gitlab> [{'id': 1, 'sha': '481ecae6ad30cb66776c9ca5211fb5c98e8800ee', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-06-29T22:10:55.544Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2001vm-test-run-nixbot-gitlab> gitlab # [  312.699503] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:10:59 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1552002vm-test-run-nixbot-gitlab> gitlab # [  313.495026] gitaly[1367]: time="2026-06-29T22:11:00.362Z" level=info msg="burden monitor stats" pid=1367 top_10_by_cpu="[]" top_10_by_memory="[]"2003vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses2004vm-test-run-nixbot-gitlab> gitlab # [  313.860625] gitaly[1367]: time="2026-06-29T22:11:00.726Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPZ3WEZNFNWJQPC9ZB7VKA grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:30.724" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:11:00.725" grpc.time_ms=1.339 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses, in 0.22 seconds)2006vm-test-run-nixbot-gitlab> [{'id': 1, 'sha': '481ecae6ad30cb66776c9ca5211fb5c98e8800ee', 'ref': 'master', 'status': 'pending', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluating flake', 'created_at': '2026-06-29T22:10:55.544Z', 'started_at': None, 'finished_at': None, 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2007vm-test-run-nixbot-gitlab> gitlab # [  313.922125] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:11:00 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses HTTP/1.1" 200 633 "" "curl/8.20.0" 1652008vm-test-run-nixbot-gitlab> gitlab # [  314.036659] gitaly[1367]: time="2026-06-29T22:11:00.904Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPZ424D03ZRAH6N2B6MEME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:30.301" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:11:00.902" grpc.time_ms=1.324 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2009vm-test-run-nixbot-gitlab> gitlab # [  314.164389] gitaly[1367]: time="2026-06-29T22:11:01.031Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KWAPZ424D03ZRAH6N2B6MEME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-29T22:11:11.004" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:11:01.014" grpc.time_ms=17 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2010vm-test-run-nixbot-gitlab> gitlab # [  314.277009] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:11:01.142Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f3894b9b835240accd02a300","created_at":"2026-06-29T22:11:01.127Z","trace_propagation_headers":{"sentry-trace":"281e7cde14a3400388da166f0e93c4ab-8823c0b2a82b42e7","baggage":"sentry-trace_id=281e7cde14a3400388da166f0e93c4ab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPZ424D03ZRAH6N2B6MEME","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-29T22:11:01.139Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f3894b9b835240accd02a300: start","job_status":"start","queue_duration_s":0.003132,"scheduling_latency_s":0.003189}2011vm-test-run-nixbot-gitlab> gitlab # [  314.324637] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:11:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/481ecae6ad30cb66776c9ca5211fb5c98e8800ee HTTP/1.1" 201 669 "" "python-httpx/0.28.1" 3702012vm-test-run-nixbot-gitlab> gitlab # [  314.331513] nixbot[3806]: {"ts": "2026-06-29T22:11:01.178Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/481ecae6ad30cb66776c9ca5211fb5c98e8800ee \"HTTP/1.1 201 Created\""}2013vm-test-run-nixbot-gitlab> gitlab # [  314.431315] gitaly[1367]: time="2026-06-29T22:11:01.298Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPZ4E2H6Z9FGQYK6GNNJKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:31.096" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:11:01.296" grpc.time_ms=1.236 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2014vm-test-run-nixbot-gitlab> gitlab # [  314.490705] gitaly[1367]: time="2026-06-29T22:11:01.357Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPZ424D03ZRAH6N2B6MEME grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:11:01.356" grpc.time_ms=0.708 pid=1367 span.kind=server system=grpc2015vm-test-run-nixbot-gitlab> gitlab # [  314.520210] gitaly[1367]: time="2026-06-29T22:11:01.385Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.StreamServerInterceptor correlation_id=01KWAPZ4E2H6Z9FGQYK6GNNJKJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-29T22:11:11.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:11:01.368" grpc.time_ms=16.486 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2016vm-test-run-nixbot-gitlab> gitlab # [  314.547703] gitaly[1367]: time="2026-06-29T22:11:01.414Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPZ424D03ZRAH6N2B6MEME grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3897 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:11:01.412" grpc.time_ms=1.486 pid=1367 span.kind=server system=grpc2017vm-test-run-nixbot-gitlab> gitlab # [  314.584905] gitaly[1367]: time="2026-06-29T22:11:01.452Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01KWAPZ424D03ZRAH6N2B6MEME grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=3899 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-06-29T22:11:01.451" grpc.time_ms=0.785 pid=1367 span.kind=server system=grpc2018vm-test-run-nixbot-gitlab> gitlab # [  314.613774] gitaly[1367]: time="2026-06-29T22:11:01.463Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01KWAPZ424D03ZRAH6N2B6MEME diskcache=9cb0842c-fd75-4b22-8417-61b90f22077b grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-29T22:11:31.207" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:11:01.308" pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2019vm-test-run-nixbot-gitlab> gitlab # [  314.641245] gitaly[1367]: time="2026-06-29T22:11:01.463Z" level=info msg="finished unary call with code OK" command.count=1 command.cpu_time_ms=142 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=6945 command.oublock=0 command.real_time_ms=147 command.spawn_token_fork_ms=1 command.system_time_ms=85 command.user_time_ms=57 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPZ424D03ZRAH6N2B6MEME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=DeleteRefs grpc.request.deadline="2026-06-29T22:11:31.207" grpc.request.fullMethod=/gitaly.RefService/DeleteRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=141 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:11:01.308" grpc.time_ms=154.811 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2020vm-test-run-nixbot-gitlab> gitlab # [  314.669650] nixbot[3806]: {"ts": "2026-06-29T22:11:01.478Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/481ecae6ad30cb66776c9ca5211fb5c98e8800ee \"HTTP/1.1 201 Created\""}2021vm-test-run-nixbot-gitlab> gitlab # [  314.674792] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:11:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/481ecae6ad30cb66776c9ca5211fb5c98e8800ee HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2902022vm-test-run-nixbot-gitlab> gitlab # [  314.713469] gitaly[1367]: time="2026-06-29T22:11:01.580Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPZ4QQ4FEKF27AZ5950X41 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:31.578" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:11:01.579" grpc.time_ms=1.24 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2023vm-test-run-nixbot-gitlab> gitlab # [  314.746740] gitaly[1367]: time="2026-06-29T22:11:01.588Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01KWAPZ424D03ZRAH6N2B6MEME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListCommitsByOid grpc.request.deadline="2026-06-29T22:11:31.486" grpc.request.fullMethod=/gitaly.CommitService/ListCommitsByOid grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:11:01.587" grpc.time_ms=1.121 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2024vm-test-run-nixbot-gitlab> gitlab # [  314.776435] gitaly[1367]: time="2026-06-29T22:11:01.643Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPZ424D03ZRAH6N2B6MEME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:31.542" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:11:01.642" grpc.time_ms=1.225 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2025vm-test-run-nixbot-gitlab> gitlab # [  314.800307] gitaly[1367]: time="2026-06-29T22:11:01.660Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=9 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=3 command.system_time_ms=7 command.user_time_ms=2 component=gitaly.StreamServerInterceptor correlation_id=01KWAPZ4QQ4FEKF27AZ5950X41 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-06-29T22:11:11.007" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-06-29T22:11:01.647" grpc.time_ms=13.052 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2026vm-test-run-nixbot-gitlab> gitlab # [  314.877287] gitaly[1367]: time="2026-06-29T22:11:01.744Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPZ424D03ZRAH6N2B6MEME grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-sidekiq grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:31.641" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=129 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:11:01.742" grpc.time_ms=1.177 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2027vm-test-run-nixbot-gitlab> gitlab # [  314.902240] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:11:01 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/481ecae6ad30cb66776c9ca5211fb5c98e8800ee HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2552028vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses2029vm-test-run-nixbot-gitlab> gitlab # [  314.907160] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:11:01.766Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"ab73d9e5e94f49b2fa7797c2","created_at":"2026-06-29T22:11:01.760Z","trace_propagation_headers":{"sentry-trace":"281e7cde14a3400388da166f0e93c4ab-d1b2eb8dbda646dd","baggage":"sentry-trace_id=281e7cde14a3400388da166f0e93c4ab,sentry-release=Unknown"},"correlation_id":"01KWAPZ424D03ZRAH6N2B6MEME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","duplicate-of":"f3894b9b835240accd02a300","job_size_bytes":3,"pid":2440,"job_status":"deduplicated","message":"PipelineProcessWorker JID-ab73d9e5e94f49b2fa7797c2: deduplicated: until executed","deduplication.type":"until executed","deduplication.options.if_deduplicated":"reschedule_once","deduplication.options.ttl":60}2030vm-test-run-nixbot-gitlab> gitlab # [  314.933827] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:11:01.771Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f3894b9b835240accd02a300","created_at":"2026-06-29T22:11:01.127Z","trace_propagation_headers":{"sentry-trace":"281e7cde14a3400388da166f0e93c4ab-8823c0b2a82b42e7","baggage":"sentry-trace_id=281e7cde14a3400388da166f0e93c4ab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPZ424D03ZRAH6N2B6MEME","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-29T22:11:01.139Z","load_balancing_strategy":"primary","job_size_bytes":3,"pid":2440,"job_status":"rescheduled","message":"PipelineProcessWorker JID-f3894b9b835240accd02a300: rescheduled"}2031vm-test-run-nixbot-gitlab> gitlab # [  314.956721] nixbot[3806]: {"ts": "2026-06-29T22:11:01.752Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/481ecae6ad30cb66776c9ca5211fb5c98e8800ee \"HTTP/1.1 201 Created\""}2032vm-test-run-nixbot-gitlab> gitlab # [  314.960885] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:11:01.790Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_processing","args":["1"],"class":"PipelineProcessWorker","jid":"f3894b9b835240accd02a300","created_at":"2026-06-29T22:11:01.127Z","trace_propagation_headers":{"sentry-trace":"281e7cde14a3400388da166f0e93c4ab-8823c0b2a82b42e7","baggage":"sentry-trace_id=281e7cde14a3400388da166f0e93c4ab,sentry-environment=,sentry-release=Unknown"},"correlation_id":"01KWAPZ424D03ZRAH6N2B6MEME","meta.caller_id":"POST /api/:version/projects/:id/statuses/:sha","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f17dab72d818b5591168c35c7bdfefd02fa3f68167592daadd7c40e5b811ce78","size_limiter":"validated","enqueued_at":"2026-06-29T22:11:01.139Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineProcessWorker JID-f3894b9b835240accd02a300: done: 0.647905 sec","job_status":"done","queue_duration_s":0.003132,"scheduling_latency_s":0.003189,"gitaly_calls":4,"gitaly_duration_s":0.174315,"redis_calls":117,"redis_allowed_cross_slot_calls":2,"redis_duration_s":0.044016,"redis_read_bytes":281,"redis_write_bytes":27407,"redis_action_cable_calls":4,"redis_action_cable_duration_s":0.001654,"redis_action_cable_read_bytes":4,"redis_action_cable_write_bytes":805,"redis_cache_calls":21,"redis_cache_allowed_cross_slot_calls":2,"redis_cache_duration_s":0.007129,"redis_cache_read_bytes":39,"redis_cache_write_bytes":1840,"redis_feature_flag_calls":26,"redis_feature_flag_duration_s":0.011233,"redis_feature_flag_read_bytes":26,"redis_feature_flag_write_bytes":4583,"redis_queues_calls":25,"redis_queues_duration_s":0.005891,"redis_queues_read_bytes":28,"redis_queues_write_bytes":14466,"redis_queues_metadata_calls":23,"redis_queues_metadata_duration_s":0.011413,"redis_queues_metadata_read_bytes":112,"redis_queues_metadata_write_bytes":3754,"redis_rate_limiting_calls":2,"redis_rate_limiting_duration_s":0.000793,"redis_rate_limiting_read_bytes":2,"redis_rate_limiting_write_bytes":166,"redis_repository_cache_calls":3,"redis_repository_cache_duration_s":0.000667,"redis_repository_cache_read_bytes":57,"redis_repository_cache_write_bytes":137,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003582,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":851,"db_count":49,"db_write_count":3,"db_cached_count":1,"db_txn_count":2,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":49,"db_replica_write_count":0,"db_primary_write_count":3,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.087,"db_main_txn_count":0,"db_ci_txn_count":2,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":34,"db_ci_count":15,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":3,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.029,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.032,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.047,"db_ci_duration_s":0.04,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.360019,"worker_id":"sidekiq_0","rate_limiting_gates":["ci_pipeline_statuses_subscription"],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.57011222,"duration_s":0.647905,"completed_at":"2026-06-29T22:11:01.790Z","load_balancing_strategy":"primary","db_duration_s":0.092852,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2033vm-test-run-nixbot-gitlab> gitlab # [  315.023412] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:11:01.793Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"883c113c34e5a41004a510a9","created_at":"2026-06-29T22:11:01.280Z","trace_propagation_headers":{"sentry-trace":"281e7cde14a3400388da166f0e93c4ab-d1b2eb8dbda646dd","baggage":"sentry-trace_id=281e7cde14a3400388da166f0e93c4ab,sentry-release=Unknown"},"correlation_id":"01KWAPZ424D03ZRAH6N2B6MEME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-06-29T22:11:01.288Z","job_size_bytes":23,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-883c113c34e5a41004a510a9: start","job_status":"start","queue_duration_s":0.504773,"scheduling_latency_s":0.504812}2034vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses, in 0.16 seconds)2035vm-test-run-nixbot-gitlab> [{'id': 1, 'sha': '481ecae6ad30cb66776c9ca5211fb5c98e8800ee', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-eval', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': 'evaluation succeeded (1 warning)', 'created_at': '2026-06-29T22:10:55.544Z', 'started_at': None, 'finished_at': '2026-06-29T22:11:01.099Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}, {'id': 2, 'sha': '481ecae6ad30cb66776c9ca5211fb5c98e8800ee', 'ref': 'master', 'status': 'success', 'name': 'nixbot/nix-build', 'target_url': 'http://localhost:8010/repos/gitlab/root/test-flake/builds/1', 'description': '0 attributes built', 'created_at': '2026-06-29T22:11:01.432Z', 'started_at': None, 'finished_at': '2026-06-29T22:11:01.704Z', 'allow_failure': False, 'coverage': None, 'pipeline_id': 1, 'author': {'id': 1, 'username': 'root', 'public_email': None, 'name': 'Administrator', 'state': 'active', 'locked': False, 'avatar_url': 'https://www.gravatar.com/avatar/2e93f8045553c109d586f91d54e4902ff14dc793562a9d2ac2ca5bb86bce6ed9?s=80&d=identicon', 'web_url': 'http://gitlab/root'}}]2036vm-test-run-nixbot-gitlab> gitlab # [  315.042654] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:11:01.909Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_default","args":["1","[FILTERED]"],"class":"PipelineNotificationWorker","jid":"883c113c34e5a41004a510a9","created_at":"2026-06-29T22:11:01.280Z","trace_propagation_headers":{"sentry-trace":"281e7cde14a3400388da166f0e93c4ab-d1b2eb8dbda646dd","baggage":"sentry-trace_id=281e7cde14a3400388da166f0e93c4ab,sentry-release=Unknown"},"correlation_id":"01KWAPZ424D03ZRAH6N2B6MEME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"continuous_integration","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f0b0c0ccc9472d6819984cd49b3aa8829dfa124660b99391ec24c08cadec0f09","size_limiter":"validated","enqueued_at":"2026-06-29T22:11:01.288Z","job_size_bytes":23,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineNotificationWorker JID-883c113c34e5a41004a510a9: done: 0.115853 sec","job_status":"done","queue_duration_s":0.504773,"scheduling_latency_s":0.504812,"redis_calls":10,"redis_duration_s":0.003045,"redis_read_bytes":9,"redis_write_bytes":1029,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000618,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":295,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001795,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":534,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000632,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":200,"db_count":12,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":12,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.019,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":11,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.005,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.005,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002607,"duration_s":0.115853,"completed_at":"2026-06-29T22:11:01.909Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.022981,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}2037vm-test-run-nixbot-gitlab> (finished: subtest: eval and build post commit statuses, in 6.34 seconds)2038vm-test-run-nixbot-gitlab> (finished: run the VM test script, in 381.94 seconds)2039vm-test-run-nixbot-gitlab> gitlab # [  315.088431] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:11:01.911Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5243619b4e1a768fef10399a","created_at":"2026-06-29T22:11:01.471Z","trace_propagation_headers":{"sentry-trace":"281e7cde14a3400388da166f0e93c4ab-d1b2eb8dbda646dd","baggage":"sentry-trace_id=281e7cde14a3400388da166f0e93c4ab,sentry-release=Unknown"},"correlation_id":"01KWAPZ424D03ZRAH6N2B6MEME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:516356bdbc9d7b42e82049f84b2c5e8c1a6e759dfce68fef2843f4d2de5c13d2","size_limiter":"validated","enqueued_at":"2026-06-29T22:11:01.482Z","job_size_bytes":3,"pid":2440,"sidekiq_tid":"m49s","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::JobArtifacts::TrackArtifactReportWorker JID-5243619b4e1a768fef10399a: start","job_status":"start","queue_duration_s":0.429558,"scheduling_latency_s":0.429579}2040vm-test-run-nixbot-gitlab> gitlab # [  315.105378] gitlab-workhorse[1291]: gitlab 2001:db8:1::1 - - [2026/06/29:22:11:01 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/commits/481ecae6ad30cb66776c9ca5211fb5c98e8800ee/statuses HTTP/1.1" 200 1328 "" "curl/8.20.0" 1022041vm-test-run-nixbot-gitlab> gitlab # [  315.114772] gitaly[1367]: time="2026-06-29T22:11:01.915Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01KWAPZ52MZN547S7C35SK4DK4 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-06-29T22:11:31.713" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.CommitService grpc.start_time="2026-06-29T22:11:01.914" grpc.time_ms=0.688 pid=1367 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2042vm-test-run-nixbot-gitlab> test script finished in 381.99s2043vm-test-run-nixbot-gitlab> cleanup2044vm-test-run-nixbot-gitlab> kill QemuMachine (pid 13)2045vm-test-run-nixbot-gitlab> gitlab # [  315.129499] sidekiq-cluster[2440]: {"severity":"INFO","time":"2026-06-29T22:11:01.957Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"pipeline_background","args":["1"],"class":"Ci::JobArtifacts::TrackArtifactReportWorker","jid":"5243619b4e1a768fef10399a","created_at":"2026-06-29T22:11:01.471Z","trace_propagation_headers":{"sentry-trace":"281e7cde14a3400388da166f0e93c4ab-d1b2eb8dbda646dd","baggage":"sentry-trace_id=281e7cde14a3400388da166f0e93c4ab,sentry-release=Unknown"},"correlation_id":"01KWAPZ424D03ZRAH6N2B6MEME","meta.caller_id":"PipelineProcessWorker","meta.remote_ip":"2001:db8:1::1","meta.feature_category":"code_testing","meta.user":"root","meta.gl_user_id":1,"meta.project":"root/test-flake","meta.root_namespace":"root","meta.client_id":"user/1","meta.root_caller_id":"POST /api/:version/projects/:id/statuses/:sha","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{}qemu-system-aarch64: terminating on signal 15 from pid 6 (/nix/store/lqn6mbgzzdrqq2qkwddcmxj9z6amdd86-python3-3.13.13/bin/python3.13)2046vm-test-run-nixbot-gitlab> gitlab # ,2047vm-test-run-nixbot-gitlab> (finished: cleanup, in 1.40 seconds)20482049post-build step Upload coverage to codecov: ok2050Skipping codecov: project=Mic92/nixbot attr=aarch64-linux.nixbot-gitlab