1this derivation will be built:2 /nix/store/zwpknfigbdaqjl8q80c18jyh5fw1hnb6-vm-test-run-nixbot-gitlab.drv3Failed to find a machine for remote build!4derivation: zwpknfigbdaqjl8q80c18jyh5fw1hnb6-vm-test-run-nixbot-gitlab.drv5required (system, features): (aarch64-linux, [kvm, nixos-test])61 available machines:7(systems, maxjobs, supportedFeatures, mandatoryFeatures)8([aarch64-darwin, x86_64-darwin], 8, [big-parallel, recursive-nix], [])9building '/nix/store/zwpknfigbdaqjl8q80c18jyh5fw1hnb6-vm-test-run-nixbot-gitlab.drv'10vm-test-run-nixbot-gitlab> tribuchet: building on eliza11vm-test-run-nixbot-gitlab> Machine state will be reset. To keep it, pass --keep-machine-state12vm-test-run-nixbot-gitlab> start all VLans13vm-test-run-nixbot-gitlab> (finished: start all VLans, in 0.00 seconds)14vm-test-run-nixbot-gitlab> Test will time out and terminate in 3600 seconds15vm-test-run-nixbot-gitlab> run the VM test script16vm-test-run-nixbot-gitlab> start all VMs17vm-test-run-nixbot-gitlab> gitlab: starting vm18vm-test-run-nixbot-gitlab> gitlab # Disk image does not exist, creating the virtualisation disk image...19vm-test-run-nixbot-gitlab> gitlab: QEMU running (pid 46)20vm-test-run-nixbot-gitlab> gitlab # Formatting '/build/vm-state-gitlab/tmp.m7BXUZLxsW', fmt=raw size=107374182421vm-test-run-nixbot-gitlab> gitlab # mke2fs 1.47.4 (6-Mar-2025)22vm-test-run-nixbot-gitlab> gitlab # Discarding device blocks: 0/262144 done23vm-test-run-nixbot-gitlab> gitlab # Creating filesystem with 262144 4k blocks and 65536 inodes24vm-test-run-nixbot-gitlab> gitlab # Filesystem UUID: f34950e2-08e0-46a9-82c7-3f1ea3c9583a25vm-test-run-nixbot-gitlab> gitlab # Superblock backups stored on blocks:26vm-test-run-nixbot-gitlab> (finished: start all VMs, in 72.11 seconds)27vm-test-run-nixbot-gitlab> gitlab # 32768, 98304, 163840, 22937628vm-test-run-nixbot-gitlab> gitlab: waiting for unit setup-gitlab.service29vm-test-run-nixbot-gitlab> gitlab # 30vm-test-run-nixbot-gitlab> gitlab: waiting for the VM to finish booting31vm-test-run-nixbot-gitlab> gitlab # Allocating group tables: 0/8 done32vm-test-run-nixbot-gitlab> gitlab # Writing inode tables: 0/8 done33vm-test-run-nixbot-gitlab> gitlab # Creating journal (8192 blocks): done34vm-test-run-nixbot-gitlab> gitlab # Writing superblocks and filesystem accounting information: 0/8 done35vm-test-run-nixbot-gitlab> gitlab # 36vm-test-run-nixbot-gitlab> gitlab # Virtualisation disk image created.37vm-test-run-nixbot-gitlab> gitlab # Creating Nix store image...38vm-test-run-nixbot-gitlab> gitlab # Created Nix store image.39vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0xc00fac40]40vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Linux version 6.18.43 (nixbld@localhost) (gcc (GCC) 15.3.0, GNU ld (GNU Binutils) 2.46) #1-NixOS SMP PREEMPT Thu Aug 6 17:27:09 UTC 202641vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] KASLR enabled42vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] random: crng init done43vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Machine model: linux,dummy-virt44vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] efi: UEFI not found.45vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] OF: reserved mem: Reserved memory: No reserved-memory node in the DT46vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] NUMA: Faking a node at [mem 0x0000000040000000-0x00000001bfffffff]47vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] NODE_DATA(0) allocated [mem 0x1bfdeb740-0x1bfdeeebf]48vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Zone ranges:49vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] DMA [mem 0x0000000040000000-0x00000000ffffffff]50vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] DMA32 empty51vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Normal [mem 0x0000000100000000-0x00000001bfffffff]52vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Device empty53vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Movable zone start for each node54vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Early memory node ranges55vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] node 0: [mem 0x0000000040000000-0x00000001bfffffff]56vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Initmem setup node 0 [mem 0x0000000040000000-0x00000001bfffffff]57vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] cma: Reserved 32 MiB at 0x00000000fe00000058vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] psci: probing for conduit method from DT.59vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] psci: PSCIv1.3 detected in firmware.60vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] psci: Using standard PSCI v0.2 function IDs61vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] psci: Trusted OS migration not required62vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] psci: SMC Calling Convention v1.163vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] smccc: KVM: hypervisor services detected (0x00000000 0x00000000 0x00000000 0x00000003)64vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] percpu: Embedded 76 pages/cpu s186712 r8192 d116392 u31129665vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Detected PIPT I-cache on CPU066vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] CPU features: detected: Address authentication (architected QARMA5 algorithm)67vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] CPU features: detected: GICv3 CPU interface68vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] CPU features: detected: Spectre-v469vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] CPU features: detected: Spectre-BHB70vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC03_CPU_3871vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] CPU features: detected: AmpereOne erratum AC04_CPU_2372vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] alternatives: applying boot alternatives73vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Kernel command line: console=ttyAMA0 console=tty0 panic=1 boot.panic_on_fail clocksource=acpi_pm root=fstab loglevel=7 net.ifnames=0 lsm=landlock,yama,bpf init=/nix/store/wn0nzrshngiw3ja5cjwm899x0xbvn0v4-nixos-system-gitlab-test/init regInfo=/nix/store/iaw20k2wgr5b4pwr7rf1ickp0yjzvmr9-closure-info/registration console=ttyAMA0,115200n8 console=tty074vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Unknown kernel command line parameters "regInfo=/nix/store/iaw20k2wgr5b4pwr7rf1ickp0yjzvmr9-closure-info/registration", will be passed to user space.75vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] printk: log buffer data + meta data: 131072 + 458752 = 589824 bytes76vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Dentry cache hash table entries: 1048576 (order: 11, 8388608 bytes, linear)77vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Inode-cache hash table entries: 524288 (order: 10, 4194304 bytes, linear)78vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] software IO TLB: area num 4.79vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] software IO TLB: mapped [mem 0x00000000fa000000-0x00000000fe000000] (64MB)80vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Fallback order for Node 0: 081vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 157286482vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Policy zone: Normal83vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] mem auto-init: stack:all(zero), heap alloc:on, heap free:off84vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=4, Nodes=185vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] allocated 12582912 bytes of page_ext86vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] ftrace: allocating 74867 entries in 294 pages87vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] ftrace: allocated 294 pages with 4 groups88vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] rcu: Hierarchical RCU implementation.89vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] rcu: RCU event tracing is enabled.90vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=384 to nr_cpu_ids=4.91vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Trampoline variant of Tasks RCU enabled.92vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Rude variant of Tasks RCU enabled.93vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Tracing variant of Tasks RCU enabled.94vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 25 jiffies.95vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=496vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] RCU Tasks: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.97vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] RCU Tasks Rude: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.98vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] RCU Tasks Trace: Setting shift to 2 and lim to 1 rcu_task_cb_adjust=1 rcu_task_cpu_ids=4.99vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] NR_IRQS: 64, nr_irqs: 64, preallocated irqs: 0100vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] GICv3: 256 SPIs implemented101vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] GICv3: 0 Extended SPIs implemented102vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] Root IRQ handler: gic_handle_irq103vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] GICv3: GICv3 features: 16 PPIs, DirectLPI104vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] GICv3: GICD_CTLR.DS=1, SCR_EL3.FIQ=0105vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] GICv3: CPU0: found redistributor 0 region 0:0x00000000080a0000106vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] ITS [mem 0x08080000-0x0809ffff]107vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Devices @100f10000 (indirect, esz 8, psz 64K, shr 1)108vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] ITS@0x0000000008080000: allocated 8192 Interrupt Collections @100f20000 (flat, esz 8, psz 64K, shr 1)109vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] GICv3: using LPI property table @0x0000000100f30000110vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] GICv3: CPU0: using allocated LPI pending table @0x0000000100f40000111vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] rcu: srcu_init: Setting srcu_struct sizes based on contention.112vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 7645041785100000 ns113vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] arch_timer: cp15 timer running at 1000.00MHz (virt).114vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] clocksource: arch_sys_counter: mask: 0x1fffffffffffffff max_cycles: 0x1cd42e4dffb, max_idle_ns: 881590591483 ns115vm-test-run-nixbot-gitlab> gitlab # [ 0.000000] sched_clock: 61 bits at 1000MHz, resolution 1ns, wraps every 4398046511103ns116vm-test-run-nixbot-gitlab> gitlab # [ 0.000028] arm-pv: using stolen time PV117vm-test-run-nixbot-gitlab> gitlab # [ 0.000390] kfence: initialized - using 2097152 bytes for 255 objects at 0x(____ptrval____)-0x(____ptrval____)118vm-test-run-nixbot-gitlab> gitlab # [ 0.000561] Console: colour dummy device 80x25119vm-test-run-nixbot-gitlab> gitlab # [ 0.000568] printk: legacy console [tty0] enabled120vm-test-run-nixbot-gitlab> gitlab # [ 0.000759] Calibrating delay loop (skipped), value calculated using timer frequency.. 2000.00 BogoMIPS (lpj=4000000)121vm-test-run-nixbot-gitlab> gitlab # [ 0.000765] pid_max: default: 32768 minimum: 301122vm-test-run-nixbot-gitlab> gitlab # [ 0.000850] LSM: initializing lsm=capability,landlock,yama,bpf,ima123vm-test-run-nixbot-gitlab> gitlab # [ 0.000993] landlock: Up and running.124vm-test-run-nixbot-gitlab> gitlab # [ 0.000995] Yama: becoming mindful.125vm-test-run-nixbot-gitlab> gitlab # [ 0.001442] LSM support for eBPF active126vm-test-run-nixbot-gitlab> gitlab # [ 0.001658] Mount-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)127vm-test-run-nixbot-gitlab> gitlab # [ 0.001778] Mountpoint-cache hash table entries: 16384 (order: 5, 131072 bytes, linear)128vm-test-run-nixbot-gitlab> gitlab # [ 0.002940] cacheinfo: Unable to detect cache hierarchy for CPU 0129vm-test-run-nixbot-gitlab> gitlab # [ 0.003815] rcu: Hierarchical SRCU implementation.130vm-test-run-nixbot-gitlab> gitlab # [ 0.003820] rcu: Max phase no-delay instances is 1000.131vm-test-run-nixbot-gitlab> gitlab # [ 0.003976] Timer migration: 1 hierarchy levels; 8 children per group; 1 crossnode level132vm-test-run-nixbot-gitlab> gitlab # [ 0.005032] fsl-mc MSI: its@8080000 domain created133vm-test-run-nixbot-gitlab> gitlab # [ 0.005127] EFI services will not be available.134vm-test-run-nixbot-gitlab> gitlab # [ 0.005291] smp: Bringing up secondary CPUs ...135vm-test-run-nixbot-gitlab> gitlab # [ 0.005959] Detected PIPT I-cache on CPU1136vm-test-run-nixbot-gitlab> gitlab # [ 0.006062] GICv3: CPU1: found redistributor 1 region 0:0x00000000080c0000137vm-test-run-nixbot-gitlab> gitlab # [ 0.006194] GICv3: CPU1: using allocated LPI pending table @0x0000000100f50000138vm-test-run-nixbot-gitlab> gitlab # [ 0.006323] CPU1: Booted secondary processor 0x0000000001 [0xc00fac40]139vm-test-run-nixbot-gitlab> gitlab # [ 0.007446] Detected PIPT I-cache on CPU2140vm-test-run-nixbot-gitlab> gitlab # [ 0.007552] GICv3: CPU2: found redistributor 2 region 0:0x00000000080e0000141vm-test-run-nixbot-gitlab> gitlab # [ 0.007684] GICv3: CPU2: using allocated LPI pending table @0x0000000100f60000142vm-test-run-nixbot-gitlab> gitlab # [ 0.007813] CPU2: Booted secondary processor 0x0000000002 [0xc00fac40]143vm-test-run-nixbot-gitlab> gitlab # [ 0.008922] Detected PIPT I-cache on CPU3144vm-test-run-nixbot-gitlab> gitlab # [ 0.009041] GICv3: CPU3: found redistributor 3 region 0:0x0000000008100000145vm-test-run-nixbot-gitlab> gitlab # [ 0.009172] GICv3: CPU3: using allocated LPI pending table @0x0000000100f70000146vm-test-run-nixbot-gitlab> gitlab # [ 0.009307] CPU3: Booted secondary processor 0x0000000003 [0xc00fac40]147vm-test-run-nixbot-gitlab> gitlab # [ 0.009830] smp: Brought up 1 node, 4 CPUs148vm-test-run-nixbot-gitlab> gitlab # [ 0.009856] SMP: Total of 4 processors activated.149vm-test-run-nixbot-gitlab> gitlab # [ 0.009858] CPU: All CPU(s) started at EL1150vm-test-run-nixbot-gitlab> gitlab # [ 0.009867] CPU features: detected: Branch Target Identification151vm-test-run-nixbot-gitlab> gitlab # [ 0.009870] CPU features: detected: ARMv8.4 Translation Table Level152vm-test-run-nixbot-gitlab> gitlab # [ 0.009873] CPU features: detected: Instruction cache invalidation not required for I/D coherence153vm-test-run-nixbot-gitlab> gitlab # [ 0.009877] CPU features: detected: Data cache clean to the PoU not required for I/D coherence154vm-test-run-nixbot-gitlab> gitlab # [ 0.009880] CPU features: detected: Common not Private translations155vm-test-run-nixbot-gitlab> gitlab # [ 0.009883] CPU features: detected: CRC32 instructions156vm-test-run-nixbot-gitlab> gitlab # [ 0.009885] CPU features: detected: Data cache clean to Point of Deep Persistence157vm-test-run-nixbot-gitlab> gitlab # [ 0.009888] CPU features: detected: Data cache clean to Point of Persistence158vm-test-run-nixbot-gitlab> gitlab # [ 0.009891] CPU features: detected: Data independent timing control (DIT)159vm-test-run-nixbot-gitlab> gitlab # [ 0.009894] CPU features: detected: E0PD160vm-test-run-nixbot-gitlab> gitlab # [ 0.009896] CPU features: detected: Enhanced Counter Virtualization161vm-test-run-nixbot-gitlab> gitlab # [ 0.009899] CPU features: detected: Enhanced Counter Virtualization (CNTPOFF)162vm-test-run-nixbot-gitlab> gitlab # [ 0.009901] CPU features: detected: Enhanced Virtualization Traps163vm-test-run-nixbot-gitlab> gitlab # [ 0.009904] CPU features: detected: Fine Grained Traps164vm-test-run-nixbot-gitlab> gitlab # [ 0.009907] CPU features: detected: Generic authentication (architected QARMA5 algorithm)165vm-test-run-nixbot-gitlab> gitlab # [ 0.009910] CPU features: detected: RCpc load-acquire (LDAPR)166vm-test-run-nixbot-gitlab> gitlab # [ 0.009913] CPU features: detected: LSE atomic instructions167vm-test-run-nixbot-gitlab> gitlab # [ 0.009915] CPU features: detected: Privileged Access Never168vm-test-run-nixbot-gitlab> gitlab # [ 0.009918] CPU features: detected: PMUv3169vm-test-run-nixbot-gitlab> gitlab # [ 0.009920] CPU features: detected: RAS Extension Support170vm-test-run-nixbot-gitlab> gitlab # [ 0.009922] CPU features: detected: RASv1p1 Extension Support171vm-test-run-nixbot-gitlab> gitlab # [ 0.009925] CPU features: detected: Random Number Generator172vm-test-run-nixbot-gitlab> gitlab # [ 0.009927] CPU features: detected: Speculation barrier (SB)173vm-test-run-nixbot-gitlab> gitlab # [ 0.009930] CPU features: detected: Stage-2 Force Write-Back174vm-test-run-nixbot-gitlab> gitlab # [ 0.009932] CPU features: detected: TLB range maintenance instructions175vm-test-run-nixbot-gitlab> gitlab # [ 0.009936] CPU features: detected: Speculative Store Bypassing Safe (SSBS)176vm-test-run-nixbot-gitlab> gitlab # [ 0.010072] alternatives: applying system-wide alternatives177vm-test-run-nixbot-gitlab> gitlab # [ 0.012921] CPU features: detected: BBM Level 2 without TLB conflict abort178vm-test-run-nixbot-gitlab> gitlab # [ 0.013176] Memory: 5963820K/6291456K available (24448K kernel code, 7090K rwdata, 26340K rodata, 4736K init, 1106K bss, 272908K reserved, 32768K cma-reserved)179vm-test-run-nixbot-gitlab> gitlab # [ 0.014654] devtmpfs: initialized180vm-test-run-nixbot-gitlab> gitlab # [ 0.018737] posixtimers hash table entries: 2048 (order: 3, 32768 bytes, linear)181vm-test-run-nixbot-gitlab> gitlab # [ 0.018815] futex hash table entries: 1024 (65536 bytes on 1 NUMA nodes, total 64 KiB, linear).182vm-test-run-nixbot-gitlab> gitlab # [ 0.019010] 2G module region forced by RANDOMIZE_MODULE_REGION_FULL183vm-test-run-nixbot-gitlab> gitlab # [ 0.019015] 0 pages in range for non-PLT usage184vm-test-run-nixbot-gitlab> gitlab # [ 0.019016] 508288 pages in range for PLT usage185vm-test-run-nixbot-gitlab> gitlab # [ 0.019141] pinctrl core: initialized pinctrl subsystem186vm-test-run-nixbot-gitlab> gitlab # [ 0.019944] DMI not present or invalid.187vm-test-run-nixbot-gitlab> gitlab # [ 0.023336] NET: Registered PF_NETLINK/PF_ROUTE protocol family188vm-test-run-nixbot-gitlab> gitlab # [ 0.026279] DMA: preallocated 1024 KiB GFP_KERNEL pool for atomic allocations189vm-test-run-nixbot-gitlab> gitlab # [ 0.026559] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations190vm-test-run-nixbot-gitlab> gitlab # [ 0.028427] DMA: preallocated 1024 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations191vm-test-run-nixbot-gitlab> gitlab # [ 0.028448] audit: initializing netlink subsys (disabled)192vm-test-run-nixbot-gitlab> gitlab # [ 0.028772] audit: type=2000 audit(0.024:1): state=initialized audit_enabled=0 res=1193vm-test-run-nixbot-gitlab> gitlab # [ 0.029285] thermal_sys: Registered thermal governor 'fair_share'194vm-test-run-nixbot-gitlab> gitlab # [ 0.029288] thermal_sys: Registered thermal governor 'bang_bang'195vm-test-run-nixbot-gitlab> gitlab # [ 0.029293] thermal_sys: Registered thermal governor 'step_wise'196vm-test-run-nixbot-gitlab> gitlab # [ 0.029295] thermal_sys: Registered thermal governor 'user_space'197vm-test-run-nixbot-gitlab> gitlab # [ 0.029298] thermal_sys: Registered thermal governor 'power_allocator'198vm-test-run-nixbot-gitlab> gitlab # [ 0.029387] cpuidle: using governor ladder199vm-test-run-nixbot-gitlab> gitlab # [ 0.029411] cpuidle: using governor menu200vm-test-run-nixbot-gitlab> gitlab # [ 0.029607] hw-breakpoint: found 16 breakpoint and 4 watchpoint registers.201vm-test-run-nixbot-gitlab> gitlab # [ 0.029820] ASID allocator initialised with 65536 entries202vm-test-run-nixbot-gitlab> gitlab # [ 0.030940] Serial: AMBA PL011 UART driver203vm-test-run-nixbot-gitlab> gitlab # [ 0.036137] 9000000.pl011: ttyAMA0 at MMIO 0x9000000 (irq = 13, base_baud = 0) is a PL011 rev1204vm-test-run-nixbot-gitlab> gitlab # [ 0.036461] printk: console [ttyAMA0] enabled205vm-test-run-nixbot-gitlab> gitlab # [ 0.047443] HugeTLB: registered 1.00 GiB page size, pre-allocated 0 pages206vm-test-run-nixbot-gitlab> gitlab # [ 0.047465] HugeTLB: 0 KiB vmemmap can be freed for a 1.00 GiB page207vm-test-run-nixbot-gitlab> gitlab # [ 0.047475] HugeTLB: registered 32.0 MiB page size, pre-allocated 0 pages208vm-test-run-nixbot-gitlab> gitlab # [ 0.047484] HugeTLB: 0 KiB vmemmap can be freed for a 32.0 MiB page209vm-test-run-nixbot-gitlab> gitlab # [ 0.047492] HugeTLB: registered 2.00 MiB page size, pre-allocated 0 pages210vm-test-run-nixbot-gitlab> gitlab # [ 0.047500] HugeTLB: 0 KiB vmemmap can be freed for a 2.00 MiB page211vm-test-run-nixbot-gitlab> gitlab # [ 0.047508] HugeTLB: registered 64.0 KiB page size, pre-allocated 0 pages212vm-test-run-nixbot-gitlab> gitlab # [ 0.047516] HugeTLB: 0 KiB vmemmap can be freed for a 64.0 KiB page213vm-test-run-nixbot-gitlab> gitlab # [ 0.060129] fbcon: Taking over console214vm-test-run-nixbot-gitlab> gitlab # [ 0.060139] ACPI: Interpreter disabled.215vm-test-run-nixbot-gitlab> gitlab # [ 0.061166] iommu: Default domain type: Translated216vm-test-run-nixbot-gitlab> gitlab # [ 0.061182] iommu: DMA domain TLB invalidation policy: strict mode217vm-test-run-nixbot-gitlab> gitlab # [ 0.076855] SCSI subsystem initialized218vm-test-run-nixbot-gitlab> gitlab # [ 0.079006] usbcore: registered new interface driver usbfs219vm-test-run-nixbot-gitlab> gitlab # [ 0.079132] usbcore: registered new interface driver hub220vm-test-run-nixbot-gitlab> gitlab # [ 0.079236] usbcore: registered new device driver usb221vm-test-run-nixbot-gitlab> gitlab # [ 0.080217] pps_core: LinuxPPS API ver. 1 registered222vm-test-run-nixbot-gitlab> gitlab # [ 0.080228] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti <giometti@linux.it>223vm-test-run-nixbot-gitlab> gitlab # [ 0.080280] PTP clock support registered224vm-test-run-nixbot-gitlab> gitlab # [ 0.080420] EDAC MC: Ver: 3.0.0225vm-test-run-nixbot-gitlab> gitlab # [ 0.081393] scmi_core: SCMI protocol bus registered226vm-test-run-nixbot-gitlab> gitlab # [ 0.082666] FPGA manager framework227vm-test-run-nixbot-gitlab> gitlab # [ 0.085214] vgaarb: loaded228vm-test-run-nixbot-gitlab> gitlab # [ 0.089108] clocksource: Switched to clocksource arch_sys_counter229vm-test-run-nixbot-gitlab> gitlab # [ 0.096459] VFS: Disk quotas dquot_6.6.0230vm-test-run-nixbot-gitlab> gitlab # [ 0.096533] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes)231vm-test-run-nixbot-gitlab> gitlab # [ 0.097433] netfs: FS-Cache loaded232vm-test-run-nixbot-gitlab> gitlab # [ 0.097709] pnp: PnP ACPI: disabled233vm-test-run-nixbot-gitlab> gitlab # [ 0.108977] NET: Registered PF_INET protocol family234vm-test-run-nixbot-gitlab> gitlab # [ 0.111662] IP idents hash table entries: 131072 (order: 8, 1048576 bytes, linear)235vm-test-run-nixbot-gitlab> gitlab # [ 0.171963] tcp_listen_portaddr_hash hash table entries: 4096 (order: 4, 65536 bytes, linear)236vm-test-run-nixbot-gitlab> gitlab # [ 0.172032] Table-perturb hash table entries: 65536 (order: 6, 262144 bytes, linear)237vm-test-run-nixbot-gitlab> gitlab # [ 0.172093] TCP established hash table entries: 65536 (order: 7, 524288 bytes, linear)238vm-test-run-nixbot-gitlab> gitlab # [ 0.172525] TCP bind hash table entries: 65536 (order: 9, 2097152 bytes, linear)239vm-test-run-nixbot-gitlab> gitlab # [ 0.173436] TCP: Hash tables configured (established 65536 bind 65536)240vm-test-run-nixbot-gitlab> gitlab # [ 0.173564] MPTCP token hash table entries: 8192 (order: 6, 196608 bytes, linear)241vm-test-run-nixbot-gitlab> gitlab # [ 0.173647] UDP hash table entries: 4096 (order: 6, 262144 bytes, linear)242vm-test-run-nixbot-gitlab> gitlab # [ 0.173818] UDP-Lite hash table entries: 4096 (order: 6, 262144 bytes, linear)243vm-test-run-nixbot-gitlab> gitlab # [ 0.174117] NET: Registered PF_UNIX/PF_LOCAL protocol family244vm-test-run-nixbot-gitlab> gitlab # [ 0.174239] NET: Registered PF_XDP protocol family245vm-test-run-nixbot-gitlab> gitlab # [ 0.174258] PCI: CLS 0 bytes, default 64246vm-test-run-nixbot-gitlab> gitlab # [ 0.174705] Trying to unpack rootfs image as initramfs...247vm-test-run-nixbot-gitlab> gitlab # [ 0.189239] kvm [1]: HYP mode not available248vm-test-run-nixbot-gitlab> gitlab # [ 0.280244] Initialise system trusted keyrings249vm-test-run-nixbot-gitlab> gitlab # [ 0.280645] workingset: timestamp_bits=42 max_order=21 bucket_order=0250vm-test-run-nixbot-gitlab> gitlab # [ 0.281751] squashfs: version 4.0 (2009/01/31) Phillip Lougher251vm-test-run-nixbot-gitlab> gitlab # [ 0.281894] 9p: Installing v9fs 9p2000 file system support252vm-test-run-nixbot-gitlab> gitlab # [ 0.299440] Key type asymmetric registered253vm-test-run-nixbot-gitlab> gitlab # [ 0.299459] Asymmetric key parser 'x509' registered254vm-test-run-nixbot-gitlab> gitlab # [ 0.299611] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 242)255vm-test-run-nixbot-gitlab> gitlab # [ 0.299971] io scheduler mq-deadline registered256vm-test-run-nixbot-gitlab> gitlab # [ 0.299988] io scheduler kyber registered257vm-test-run-nixbot-gitlab> gitlab # [ 0.315885] pl061_gpio 9030000.pl061: PL061 GPIO chip registered258vm-test-run-nixbot-gitlab> gitlab # [ 0.321274] ledtrig-cpu: registered to indicate activity on CPUs259vm-test-run-nixbot-gitlab> gitlab # [ 0.322309] pci-host-generic 4010000000.pcie: host bridge /pcie@10000000 ranges:260vm-test-run-nixbot-gitlab> gitlab # [ 0.322342] pci-host-generic 4010000000.pcie: IO 0x003eff0000..0x003effffff -> 0x0000000000261vm-test-run-nixbot-gitlab> gitlab # [ 0.322367] pci-host-generic 4010000000.pcie: MEM 0x0010000000..0x003efeffff -> 0x0010000000262vm-test-run-nixbot-gitlab> gitlab # [ 0.322384] pci-host-generic 4010000000.pcie: MEM 0x8000000000..0xffffffffff -> 0x8000000000263vm-test-run-nixbot-gitlab> gitlab # [ 0.322448] pci-host-generic 4010000000.pcie: Memory resource size exceeds max for 32 bits264vm-test-run-nixbot-gitlab> gitlab # [ 0.322500] pci-host-generic 4010000000.pcie: ECAM at [mem 0x4010000000-0x401fffffff] for [bus 00-ff]265vm-test-run-nixbot-gitlab> gitlab # [ 0.322695] pci-host-generic 4010000000.pcie: PCI host bridge to bus 0000:00266vm-test-run-nixbot-gitlab> gitlab # [ 0.322715] pci_bus 0000:00: root bus resource [bus 00-ff]267vm-test-run-nixbot-gitlab> gitlab # [ 0.322726] pci_bus 0000:00: root bus resource [io 0x0000-0xffff]268vm-test-run-nixbot-gitlab> gitlab # [ 0.322735] pci_bus 0000:00: root bus resource [mem 0x10000000-0x3efeffff]269vm-test-run-nixbot-gitlab> gitlab # [ 0.322745] pci_bus 0000:00: root bus resource [mem 0x8000000000-0xffffffffff]270vm-test-run-nixbot-gitlab> gitlab # [ 0.322986] pci 0000:00:00.0: [1b36:0008] type 00 class 0x060000 conventional PCI endpoint271vm-test-run-nixbot-gitlab> gitlab # [ 0.324444] pci 0000:00:01.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint272vm-test-run-nixbot-gitlab> gitlab # [ 0.325098] pci 0000:00:01.0: BAR 0 [io 0x0000-0x001f]273vm-test-run-nixbot-gitlab> gitlab # [ 0.325199] pci 0000:00:01.0: BAR 1 [mem 0x00000000-0x00000fff]274vm-test-run-nixbot-gitlab> gitlab # [ 0.325279] pci 0000:00:01.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]275vm-test-run-nixbot-gitlab> gitlab # [ 0.325317] pci 0000:00:01.0: ROM [mem 0x00000000-0x0003ffff pref]276vm-test-run-nixbot-gitlab> gitlab # [ 0.326807] pci 0000:00:02.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint277vm-test-run-nixbot-gitlab> gitlab # [ 0.327459] pci 0000:00:02.0: BAR 0 [io 0x0000-0x001f]278vm-test-run-nixbot-gitlab> gitlab # [ 0.327496] pci 0000:00:02.0: BAR 1 [mem 0x00000000-0x00000fff]279vm-test-run-nixbot-gitlab> gitlab # [ 0.327575] pci 0000:00:02.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]280vm-test-run-nixbot-gitlab> gitlab # [ 0.329044] pci 0000:00:03.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint281vm-test-run-nixbot-gitlab> gitlab # [ 0.329703] pci 0000:00:03.0: BAR 0 [io 0x0000-0x001f]282vm-test-run-nixbot-gitlab> gitlab # [ 0.329749] pci 0000:00:03.0: BAR 1 [mem 0x00000000-0x00000fff]283vm-test-run-nixbot-gitlab> gitlab # [ 0.329841] pci 0000:00:03.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]284vm-test-run-nixbot-gitlab> gitlab # [ 0.331344] pci 0000:00:04.0: [1af4:1009] type 00 class 0x000200 conventional PCI endpoint285vm-test-run-nixbot-gitlab> gitlab # [ 0.331927] pci 0000:00:04.0: BAR 0 [io 0x0000-0x001f]286vm-test-run-nixbot-gitlab> gitlab # [ 0.331961] pci 0000:00:04.0: BAR 1 [mem 0x00000000-0x00000fff]287vm-test-run-nixbot-gitlab> gitlab # [ 0.332040] pci 0000:00:04.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]288vm-test-run-nixbot-gitlab> gitlab # [ 0.333584] pci 0000:00:05.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint289vm-test-run-nixbot-gitlab> gitlab # [ 0.334185] pci 0000:00:05.0: BAR 0 [io 0x0000-0x007f]290vm-test-run-nixbot-gitlab> gitlab # [ 0.334220] pci 0000:00:05.0: BAR 1 [mem 0x00000000-0x00000fff]291vm-test-run-nixbot-gitlab> gitlab # [ 0.334298] pci 0000:00:05.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]292vm-test-run-nixbot-gitlab> gitlab # [ 0.335811] pci 0000:00:06.0: [1af4:1001] type 00 class 0x010000 conventional PCI endpoint293vm-test-run-nixbot-gitlab> gitlab # [ 0.336463] pci 0000:00:06.0: BAR 0 [io 0x0000-0x007f]294vm-test-run-nixbot-gitlab> gitlab # [ 0.336499] pci 0000:00:06.0: BAR 1 [mem 0x00000000-0x00000fff]295vm-test-run-nixbot-gitlab> gitlab # [ 0.336578] pci 0000:00:06.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]296vm-test-run-nixbot-gitlab> gitlab # [ 0.338155] pci 0000:00:07.0: [1af4:1000] type 00 class 0x020000 conventional PCI endpoint297vm-test-run-nixbot-gitlab> gitlab # [ 0.338773] pci 0000:00:07.0: BAR 0 [io 0x0000-0x001f]298vm-test-run-nixbot-gitlab> gitlab # [ 0.338807] pci 0000:00:07.0: BAR 1 [mem 0x00000000-0x00000fff]299vm-test-run-nixbot-gitlab> gitlab # [ 0.338886] pci 0000:00:07.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]300vm-test-run-nixbot-gitlab> gitlab # [ 0.338921] pci 0000:00:07.0: ROM [mem 0x00000000-0x0003ffff pref]301vm-test-run-nixbot-gitlab> gitlab # [ 0.340493] pci 0000:00:08.0: [1af4:1050] type 00 class 0x038000 conventional PCI endpoint302vm-test-run-nixbot-gitlab> gitlab # [ 0.341135] pci 0000:00:08.0: BAR 1 [mem 0x00000000-0x00000fff]303vm-test-run-nixbot-gitlab> gitlab # [ 0.341216] pci 0000:00:08.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]304vm-test-run-nixbot-gitlab> gitlab # [ 0.342685] pci 0000:00:09.0: [1af4:1052] type 00 class 0x090000 conventional PCI endpoint305vm-test-run-nixbot-gitlab> gitlab # [ 0.343323] pci 0000:00:09.0: BAR 1 [mem 0x00000000-0x00000fff]306vm-test-run-nixbot-gitlab> gitlab # [ 0.343408] pci 0000:00:09.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]307vm-test-run-nixbot-gitlab> gitlab # [ 0.344642] pci 0000:00:0a.0: [8086:24cd] type 00 class 0x0c0320 conventional PCI endpoint308vm-test-run-nixbot-gitlab> gitlab # [ 0.345265] pci 0000:00:0a.0: BAR 0 [mem 0x00000000-0x00000fff]309vm-test-run-nixbot-gitlab> gitlab # [ 0.346047] pci 0000:00:0b.0: [1af4:1003] type 00 class 0x078000 conventional PCI endpoint310vm-test-run-nixbot-gitlab> gitlab # [ 0.346775] pci 0000:00:0b.0: BAR 0 [io 0x0000-0x003f]311vm-test-run-nixbot-gitlab> gitlab # [ 0.346810] pci 0000:00:0b.0: BAR 1 [mem 0x00000000-0x00000fff]312vm-test-run-nixbot-gitlab> gitlab # [ 0.346887] pci 0000:00:0b.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]313vm-test-run-nixbot-gitlab> gitlab # [ 0.348397] pci 0000:00:0c.0: [1af4:1005] type 00 class 0x00ff00 conventional PCI endpoint314vm-test-run-nixbot-gitlab> gitlab # [ 0.349006] pci 0000:00:0c.0: BAR 0 [io 0x0000-0x001f]315vm-test-run-nixbot-gitlab> gitlab # [ 0.349050] pci 0000:00:0c.0: BAR 1 [mem 0x00000000-0x00000fff]316vm-test-run-nixbot-gitlab> gitlab # [ 0.349173] pci 0000:00:0c.0: BAR 4 [mem 0x00000000-0x00003fff 64bit pref]317vm-test-run-nixbot-gitlab> gitlab # [ 0.351026] pci 0000:00:01.0: ROM [mem 0x10000000-0x1003ffff pref]: assigned318vm-test-run-nixbot-gitlab> gitlab # [ 0.351045] pci 0000:00:07.0: ROM [mem 0x10040000-0x1007ffff pref]: assigned319vm-test-run-nixbot-gitlab> gitlab # [ 0.351056] pci 0000:00:01.0: BAR 4 [mem 0x8000000000-0x8000003fff 64bit pref]: assigned320vm-test-run-nixbot-gitlab> gitlab # [ 0.351212] pci 0000:00:02.0: BAR 4 [mem 0x8000004000-0x8000007fff 64bit pref]: assigned321vm-test-run-nixbot-gitlab> gitlab # [ 0.351367] pci 0000:00:03.0: BAR 4 [mem 0x8000008000-0x800000bfff 64bit pref]: assigned322vm-test-run-nixbot-gitlab> gitlab # [ 0.351514] pci 0000:00:04.0: BAR 4 [mem 0x800000c000-0x800000ffff 64bit pref]: assigned323vm-test-run-nixbot-gitlab> gitlab # [ 0.351660] pci 0000:00:05.0: BAR 4 [mem 0x8000010000-0x8000013fff 64bit pref]: assigned324vm-test-run-nixbot-gitlab> gitlab # [ 0.351823] pci 0000:00:06.0: BAR 4 [mem 0x8000014000-0x8000017fff 64bit pref]: assigned325vm-test-run-nixbot-gitlab> gitlab # [ 0.351956] pci 0000:00:07.0: BAR 4 [mem 0x8000018000-0x800001bfff 64bit pref]: assigned326vm-test-run-nixbot-gitlab> gitlab # [ 0.352102] pci 0000:00:08.0: BAR 4 [mem 0x800001c000-0x800001ffff 64bit pref]: assigned327vm-test-run-nixbot-gitlab> gitlab # [ 0.352250] pci 0000:00:09.0: BAR 4 [mem 0x8000020000-0x8000023fff 64bit pref]: assigned328vm-test-run-nixbot-gitlab> gitlab # [ 0.352398] pci 0000:00:0b.0: BAR 4 [mem 0x8000024000-0x8000027fff 64bit pref]: assigned329vm-test-run-nixbot-gitlab> gitlab # [ 0.352566] pci 0000:00:0c.0: BAR 4 [mem 0x8000028000-0x800002bfff 64bit pref]: assigned330vm-test-run-nixbot-gitlab> gitlab # [ 0.352724] pci 0000:00:01.0: BAR 1 [mem 0x10080000-0x10080fff]: assigned331vm-test-run-nixbot-gitlab> gitlab # [ 0.352779] pci 0000:00:02.0: BAR 1 [mem 0x10081000-0x10081fff]: assigned332vm-test-run-nixbot-gitlab> gitlab # [ 0.352833] pci 0000:00:03.0: BAR 1 [mem 0x10082000-0x10082fff]: assigned333vm-test-run-nixbot-gitlab> gitlab # [ 0.352890] pci 0000:00:04.0: BAR 1 [mem 0x10083000-0x10083fff]: assigned334vm-test-run-nixbot-gitlab> gitlab # [ 0.352955] pci 0000:00:05.0: BAR 1 [mem 0x10084000-0x10084fff]: assigned335vm-test-run-nixbot-gitlab> gitlab # [ 0.353009] pci 0000:00:06.0: BAR 1 [mem 0x10085000-0x10085fff]: assigned336vm-test-run-nixbot-gitlab> gitlab # [ 0.353065] pci 0000:00:07.0: BAR 1 [mem 0x10086000-0x10086fff]: assigned337vm-test-run-nixbot-gitlab> gitlab # [ 0.353154] pci 0000:00:08.0: BAR 1 [mem 0x10087000-0x10087fff]: assigned338vm-test-run-nixbot-gitlab> gitlab # [ 0.353212] pci 0000:00:09.0: BAR 1 [mem 0x10088000-0x10088fff]: assigned339vm-test-run-nixbot-gitlab> gitlab # [ 0.353267] pci 0000:00:0a.0: BAR 0 [mem 0x10089000-0x10089fff]: assigned340vm-test-run-nixbot-gitlab> gitlab # [ 0.353324] pci 0000:00:0b.0: BAR 1 [mem 0x1008a000-0x1008afff]: assigned341vm-test-run-nixbot-gitlab> gitlab # [ 0.353381] pci 0000:00:0c.0: BAR 1 [mem 0x1008b000-0x1008bfff]: assigned342vm-test-run-nixbot-gitlab> gitlab # [ 0.353435] pci 0000:00:05.0: BAR 0 [io 0x1000-0x107f]: assigned343vm-test-run-nixbot-gitlab> gitlab # [ 0.353501] pci 0000:00:06.0: BAR 0 [io 0x1080-0x10ff]: assigned344vm-test-run-nixbot-gitlab> gitlab # [ 0.353554] pci 0000:00:0b.0: BAR 0 [io 0x1100-0x113f]: assigned345vm-test-run-nixbot-gitlab> gitlab # [ 0.353607] pci 0000:00:01.0: BAR 0 [io 0x1140-0x115f]: assigned346vm-test-run-nixbot-gitlab> gitlab # [ 0.353671] pci 0000:00:02.0: BAR 0 [io 0x1160-0x117f]: assigned347vm-test-run-nixbot-gitlab> gitlab # [ 0.353726] pci 0000:00:03.0: BAR 0 [io 0x1180-0x119f]: assigned348vm-test-run-nixbot-gitlab> gitlab # [ 0.353781] pci 0000:00:04.0: BAR 0 [io 0x11a0-0x11bf]: assigned349vm-test-run-nixbot-gitlab> gitlab # [ 0.353845] pci 0000:00:07.0: BAR 0 [io 0x11c0-0x11df]: assigned350vm-test-run-nixbot-gitlab> gitlab # [ 0.353900] pci 0000:00:0c.0: BAR 0 [io 0x11e0-0x11ff]: assigned351vm-test-run-nixbot-gitlab> gitlab # [ 0.353965] pci_bus 0000:00: resource 4 [io 0x0000-0xffff]352vm-test-run-nixbot-gitlab> gitlab # [ 0.353980] pci_bus 0000:00: resource 5 [mem 0x10000000-0x3efeffff]353vm-test-run-nixbot-gitlab> gitlab # [ 0.353989] pci_bus 0000:00: resource 6 [mem 0x8000000000-0xffffffffff]354vm-test-run-nixbot-gitlab> gitlab # [ 0.357803] pci 0000:00:0a.0: enabling device (0000 -> 0002)355vm-test-run-nixbot-gitlab> gitlab # [ 0.389028] virtio-pci 0000:00:01.0: enabling device (0000 -> 0003)356vm-test-run-nixbot-gitlab> gitlab # [ 0.393388] virtio-pci 0000:00:02.0: enabling device (0000 -> 0003)357vm-test-run-nixbot-gitlab> gitlab # [ 0.397598] virtio-pci 0000:00:03.0: enabling device (0000 -> 0003)358vm-test-run-nixbot-gitlab> gitlab # [ 0.403899] virtio-pci 0000:00:04.0: enabling device (0000 -> 0003)359vm-test-run-nixbot-gitlab> gitlab # [ 0.408272] virtio-pci 0000:00:05.0: enabling device (0000 -> 0003)360vm-test-run-nixbot-gitlab> gitlab # [ 0.412572] virtio-pci 0000:00:06.0: enabling device (0000 -> 0003)361vm-test-run-nixbot-gitlab> gitlab # [ 0.419148] virtio-pci 0000:00:07.0: enabling device (0000 -> 0003)362vm-test-run-nixbot-gitlab> gitlab # [ 0.423964] virtio-pci 0000:00:08.0: enabling device (0000 -> 0002)363vm-test-run-nixbot-gitlab> gitlab # [ 0.429355] virtio-pci 0000:00:09.0: enabling device (0000 -> 0002)364vm-test-run-nixbot-gitlab> gitlab # [ 0.434417] virtio-pci 0000:00:0b.0: enabling device (0000 -> 0003)365vm-test-run-nixbot-gitlab> gitlab # [ 0.439497] virtio-pci 0000:00:0c.0: enabling device (0000 -> 0003)366vm-test-run-nixbot-gitlab> gitlab # [ 0.452935] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled367vm-test-run-nixbot-gitlab> gitlab # [ 0.456452] msm_serial: driver initialized368vm-test-run-nixbot-gitlab> gitlab # [ 0.456716] SuperH (H)SCI(F) driver initialized369vm-test-run-nixbot-gitlab> gitlab # [ 0.456814] STM32 USART driver initialized370vm-test-run-nixbot-gitlab> gitlab # [ 0.498713] loop: module loaded371vm-test-run-nixbot-gitlab> gitlab # [ 0.499329] virtio_blk virtio4: 4/0/0 default/read/poll queues372vm-test-run-nixbot-gitlab> gitlab # [ 0.504939] virtio_blk virtio4: [vda] 2097152 512-byte logical blocks (1.07 GB/1.00 GiB)373vm-test-run-nixbot-gitlab> gitlab # [ 0.509869] virtio_blk virtio5: 4/0/0 default/read/poll queues374vm-test-run-nixbot-gitlab> gitlab # [ 0.514920] virtio_blk virtio5: [vdb] 12285464 512-byte logical blocks (6.29 GB/5.86 GiB)375vm-test-run-nixbot-gitlab> gitlab # [ 0.520272] megasas: 07.734.00.00-rc1376vm-test-run-nixbot-gitlab> gitlab # [ 0.522409] physmap-flash 0.flash: physmap platform flash device: [mem 0x00000000-0x03ffffff]377vm-test-run-nixbot-gitlab> gitlab # [ 0.528254] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000378vm-test-run-nixbot-gitlab> gitlab # [ 0.528406] Intel/Sharp Extended Query Table at 0x0031379vm-test-run-nixbot-gitlab> gitlab # [ 0.533840] Using buffer write method380vm-test-run-nixbot-gitlab> gitlab # [ 0.533971] physmap-flash 0.flash: physmap platform flash device: [mem 0x04000000-0x07ffffff]381vm-test-run-nixbot-gitlab> gitlab # [ 0.538573] 0.flash: Found 2 x16 devices at 0x0 in 32-bit bank. Manufacturer ID 0x000000 Chip ID 0x000000382vm-test-run-nixbot-gitlab> gitlab # [ 0.538612] Intel/Sharp Extended Query Table at 0x0031383vm-test-run-nixbot-gitlab> gitlab # [ 0.543569] Using buffer write method384vm-test-run-nixbot-gitlab> gitlab # [ 0.543601] Concatenating MTD devices:385vm-test-run-nixbot-gitlab> gitlab # [ 0.543608] (0): "0.flash"386vm-test-run-nixbot-gitlab> gitlab # [ 0.543615] (1): "0.flash"387vm-test-run-nixbot-gitlab> gitlab # [ 0.543621] into device "0.flash"388vm-test-run-nixbot-gitlab> gitlab # [ 0.629401] Freeing initrd memory: 27184K389vm-test-run-nixbot-gitlab> gitlab # [ 0.647377] tun: Universal TUN/TAP device driver, 1.6390vm-test-run-nixbot-gitlab> gitlab # [ 0.656005] thunder_xcv, ver 1.0391vm-test-run-nixbot-gitlab> gitlab # [ 0.656104] thunder_bgx, ver 1.0392vm-test-run-nixbot-gitlab> gitlab # [ 0.656184] nicpf, ver 1.0393vm-test-run-nixbot-gitlab> gitlab # [ 0.657876] e1000: Intel(R) PRO/1000 Network Driver394vm-test-run-nixbot-gitlab> gitlab # [ 0.657888] e1000: Copyright (c) 1999-2006 Intel Corporation.395vm-test-run-nixbot-gitlab> gitlab # [ 0.657951] e1000e: Intel(R) PRO/1000 Network Driver396vm-test-run-nixbot-gitlab> gitlab # [ 0.657964] e1000e: Copyright(c) 1999 - 2015 Intel Corporation.397vm-test-run-nixbot-gitlab> gitlab # [ 0.658078] igb: Intel(R) Gigabit Ethernet Network Driver398vm-test-run-nixbot-gitlab> gitlab # [ 0.658088] igb: Copyright (c) 2007-2014 Intel Corporation.399vm-test-run-nixbot-gitlab> gitlab # [ 0.658146] igbvf: Intel(R) Gigabit Virtual Function Network Driver400vm-test-run-nixbot-gitlab> gitlab # [ 0.658156] igbvf: Copyright (c) 2009 - 2012 Intel Corporation.401vm-test-run-nixbot-gitlab> gitlab # [ 0.658539] sky2: driver version 1.30402vm-test-run-nixbot-gitlab> gitlab # [ 0.663295] usbcore: registered new interface driver usb-storage403vm-test-run-nixbot-gitlab> gitlab # [ 0.663616] ehci-pci 0000:00:0a.0: EHCI Host Controller404vm-test-run-nixbot-gitlab> gitlab # [ 0.663670] ehci-pci 0000:00:0a.0: new USB bus registered, assigned bus number 1405vm-test-run-nixbot-gitlab> gitlab # [ 0.663689] usbcore: registered new interface driver usbserial_generic406vm-test-run-nixbot-gitlab> gitlab # [ 0.663730] usbserial: USB Serial support registered for generic407vm-test-run-nixbot-gitlab> gitlab # [ 0.664191] ehci-pci 0000:00:0a.0: irq 15, io mem 0x10089000408vm-test-run-nixbot-gitlab> gitlab # [ 0.665498] hv_vmbus: registering driver hyperv_keyboard409vm-test-run-nixbot-gitlab> gitlab # [ 0.667947] rtc-pl031 9010000.pl031: registered as rtc0410vm-test-run-nixbot-gitlab> gitlab # [ 0.668007] rtc-pl031 9010000.pl031: setting system clock to 2026-09-14T09:27:57 UTC (1789378077)411vm-test-run-nixbot-gitlab> gitlab # [ 0.668924] i2c_dev: i2c /dev entries driver412vm-test-run-nixbot-gitlab> gitlab # [ 0.673235] ehci-pci 0000:00:0a.0: USB 2.0 started, EHCI 1.00413vm-test-run-nixbot-gitlab> gitlab # [ 0.674024] hub 1-0:1.0: USB hub found414vm-test-run-nixbot-gitlab> gitlab # [ 0.674088] hub 1-0:1.0: 6 ports detected415vm-test-run-nixbot-gitlab> gitlab # [ 0.677021] sdhci: Secure Digital Host Controller Interface driver416vm-test-run-nixbot-gitlab> gitlab # [ 0.677036] sdhci: Copyright(c) Pierre Ossman417vm-test-run-nixbot-gitlab> gitlab # [ 0.677834] Synopsys Designware Multimedia Card Interface Driver418vm-test-run-nixbot-gitlab> gitlab # [ 0.678974] sdhci-pltfm: SDHCI platform and OF driver helper419vm-test-run-nixbot-gitlab> gitlab # [ 0.683882] hid: raw HID events driver (C) Jiri Kosina420vm-test-run-nixbot-gitlab> gitlab # [ 0.684817] usbcore: registered new interface driver usbhid421vm-test-run-nixbot-gitlab> gitlab # [ 0.684829] usbhid: USB HID core driver422vm-test-run-nixbot-gitlab> gitlab # [ 0.711553] hw perfevents: enabled with armv8_pmuv3 PMU driver, 11 (0,800003ff) counters available423vm-test-run-nixbot-gitlab> gitlab # [ 0.716070] drop_monitor: Initializing network drop monitor service424vm-test-run-nixbot-gitlab> gitlab # [ 0.716479] NET: Registered PF_INET6 protocol family425vm-test-run-nixbot-gitlab> gitlab # [ 0.718539] Segment Routing with IPv6426vm-test-run-nixbot-gitlab> gitlab # [ 0.718572] In-situ OAM (IOAM) with IPv6427vm-test-run-nixbot-gitlab> gitlab # [ 0.718760] NET: Registered PF_PACKET protocol family428vm-test-run-nixbot-gitlab> gitlab # [ 0.719126] 9pnet: Installing 9P2000 support429vm-test-run-nixbot-gitlab> gitlab # [ 0.723183] Key type dns_resolver registered430vm-test-run-nixbot-gitlab> gitlab # [ 0.739351] registered taskstats version 1431vm-test-run-nixbot-gitlab> gitlab # [ 0.739781] Loading compiled-in X.509 certificates432vm-test-run-nixbot-gitlab> gitlab # [ 0.757279] Demotion targets for Node 0: null433vm-test-run-nixbot-gitlab> gitlab # [ 0.757585] Key type .fscrypt registered434vm-test-run-nixbot-gitlab> gitlab # [ 0.757595] Key type fscrypt-provisioning registered435vm-test-run-nixbot-gitlab> gitlab # [ 0.757874] ima: No TPM chip found, activating TPM-bypass!436vm-test-run-nixbot-gitlab> gitlab # [ 0.757903] ima: Allocated hash algorithm: sha1437vm-test-run-nixbot-gitlab> gitlab # [ 0.757942] ima: No architecture policies found438vm-test-run-nixbot-gitlab> gitlab # [ 0.759610] input: gpio-keys as /devices/platform/gpio-keys/input/input0439vm-test-run-nixbot-gitlab> gitlab # [ 0.798359] clk: Disabling unused clocks440vm-test-run-nixbot-gitlab> gitlab # [ 0.798397] PM: genpd: Disabling unused power domains441vm-test-run-nixbot-gitlab> gitlab # [ 0.805622] Freeing unused kernel memory: 4736K442vm-test-run-nixbot-gitlab> gitlab # [ 0.805924] Run /init as init process443vm-test-run-nixbot-gitlab> gitlab # [ 0.852390] systemd[1]: Successfully made /usr/ read-only.444vm-test-run-nixbot-gitlab> gitlab # [ 0.925177] usb 1-1: new high-speed USB device number 2 using ehci-pci445vm-test-run-nixbot-gitlab> gitlab # [ 1.079820] input: QEMU QEMU USB Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-1/1-1:1.0/0003:0627:0001.0001/input/input1446vm-test-run-nixbot-gitlab> gitlab # [ 1.165559] hid-generic 0003:0627:0001.0001: input,hidraw0: USB HID v1.11 Keyboard [QEMU QEMU USB Keyboard] on usb-0000:00:0a.0-1/input0447vm-test-run-nixbot-gitlab> gitlab # [ 1.187151] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)448vm-test-run-nixbot-gitlab> gitlab # [ 1.187215] systemd[1]: Detected virtualization qemu.449vm-test-run-nixbot-gitlab> gitlab # [ 1.187282] systemd[1]: Detected architecture arm64.450vm-test-run-nixbot-gitlab> gitlab # [ 1.187297] systemd[1]: Running in initrd.451vm-test-run-nixbot-gitlab> gitlab # [ 1.188117] systemd[1]: Initializing machine ID from random generator.452vm-test-run-nixbot-gitlab> gitlab # [ 1.188367] systemd[1]: Hostname set to <gitlab>.453vm-test-run-nixbot-gitlab> gitlab # [ 1.285233] usb 1-2: new high-speed USB device number 3 using ehci-pci454vm-test-run-nixbot-gitlab> gitlab # [ 1.437401] input: QEMU QEMU USB Tablet as /devices/platform/4010000000.pcie/pci0000:00/0000:00:0a.0/usb1/1-2/1-2:1.0/0003:0627:0001.0002/input/input2455vm-test-run-nixbot-gitlab> gitlab # [ 1.437745] hid-generic 0003:0627:0001.0002: input,hidraw1: USB HID v0.01 Mouse [QEMU QEMU USB Tablet] on usb-0000:00:0a.0-2/input0456vm-test-run-nixbot-gitlab> gitlab # [ 1.438658] systemd[1]: bpf-restrict-fs: LSM BPF program attached457vm-test-run-nixbot-gitlab> gitlab # [ 1.514244] systemd[1]: Queued start job for default target Initrd Default Target.458vm-test-run-nixbot-gitlab> gitlab # [ 1.540459] systemd[1]: Created slice Slice /system/modprobe.459vm-test-run-nixbot-gitlab> gitlab # [ 1.540749] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.460vm-test-run-nixbot-gitlab> gitlab # [ 1.540794] systemd[1]: Expecting device /dev/disk/by-label/nix-store...461vm-test-run-nixbot-gitlab> gitlab # [ 1.540810] systemd[1]: Expecting device /dev/disk/by-label/nixos...462vm-test-run-nixbot-gitlab> gitlab # [ 1.540839] systemd[1]: Reached target Path Units.463vm-test-run-nixbot-gitlab> gitlab # [ 1.540861] systemd[1]: Reached target Slice Units.464vm-test-run-nixbot-gitlab> gitlab # [ 1.540885] systemd[1]: Reached target Swaps.465vm-test-run-nixbot-gitlab> gitlab # [ 1.540908] systemd[1]: Reached target Timer Units.466vm-test-run-nixbot-gitlab> gitlab # [ 1.541155] systemd[1]: Listening on D-Bus System Message Bus Socket.467vm-test-run-nixbot-gitlab> gitlab # [ 1.541367] systemd[1]: Listening on Journal Socket (/dev/log).468vm-test-run-nixbot-gitlab> gitlab # [ 1.541553] systemd[1]: Listening on Journal Sockets.469vm-test-run-nixbot-gitlab> gitlab # [ 1.541729] systemd[1]: Listening on udev Control Socket.470vm-test-run-nixbot-gitlab> gitlab # [ 1.541835] systemd[1]: Listening on udev Kernel Socket.471vm-test-run-nixbot-gitlab> gitlab # [ 1.541861] systemd[1]: Reached target Socket Units.472vm-test-run-nixbot-gitlab> gitlab # [ 1.543900] systemd[1]: Starting Create List of Static Device Nodes...473vm-test-run-nixbot-gitlab> gitlab # [ 1.546011] systemd[1]: Starting Load Kernel Module 9pnet_virtio...474vm-test-run-nixbot-gitlab> gitlab # [ 1.546096] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs475vm-test-run-nixbot-gitlab> gitlab # [ 1.548086] systemd[1]: Mounting Kernel Configuration File System...476vm-test-run-nixbot-gitlab> gitlab # [ 1.575596] systemd[1]: Starting Journal Service...477vm-test-run-nixbot-gitlab> gitlab # [ 1.579312] systemd[1]: Starting Load Kernel Modules...478vm-test-run-nixbot-gitlab> gitlab # [ 1.579517] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os479vm-test-run-nixbot-gitlab> gitlab # [ 1.582740] systemd[1]: Starting Coldplug All udev Devices...480vm-test-run-nixbot-gitlab> gitlab # [ 1.591571] systemd[1]: Finished Create List of Static Device Nodes.481vm-test-run-nixbot-gitlab> gitlab # [ 1.594161] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.482vm-test-run-nixbot-gitlab> gitlab # [ 1.595013] systemd[1]: Finished Load Kernel Module 9pnet_virtio.483vm-test-run-nixbot-gitlab> gitlab # [ 1.596207] systemd[1]: Mounted Kernel Configuration File System.484vm-test-run-nixbot-gitlab> gitlab # [ 1.600326] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...485vm-test-run-nixbot-gitlab> gitlab # [ 1.607479] device-mapper: core: CONFIG_IMA_DISABLE_HTABLE is disabled. Duplicate IMA measurements will not be recorded in the IMA log.486vm-test-run-nixbot-gitlab> gitlab # [ 1.615692] device-mapper: ioctl: 4.50.0-ioctl (2025-04-28) initialised: dm-devel@lists.linux.dev487vm-test-run-nixbot-gitlab> gitlab # [ 1.621577] [drm] pci: virtio-gpu-pci detected at 0000:00:08.0488vm-test-run-nixbot-gitlab> gitlab # [ 1.621910] [drm] features: -virgl +edid -resource_blob -host_visible489vm-test-run-nixbot-gitlab> gitlab # [ 1.621915] [drm] features: -context_init490vm-test-run-nixbot-gitlab> gitlab # [ 1.622985] [drm] number of scanouts: 1491vm-test-run-nixbot-gitlab> gitlab # [ 1.623001] [drm] number of cap sets: 0492vm-test-run-nixbot-gitlab> gitlab # [ 1.629783] virtio-pci 0000:00:08.0: [drm] Registered 1 planes with drm panic493vm-test-run-nixbot-gitlab> gitlab # [ 1.629817] [drm] Initialized virtio_gpu 0.1.0 for 0000:00:08.0 on minor 0494vm-test-run-nixbot-gitlab> gitlab # [ 1.632612] systemd-journald[94]: Collecting audit messages is disabled.495vm-test-run-nixbot-gitlab> gitlab # [ 1.633723] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.496vm-test-run-nixbot-gitlab> gitlab # [ 1.639449] systemd[1]: Starting Create Static Device Nodes in /dev...497vm-test-run-nixbot-gitlab> gitlab # [ 1.651245] Console: switching to colour frame buffer device 160x50498vm-test-run-nixbot-gitlab> gitlab # [ 1.652516] virtio-pci 0000:00:08.0: [drm] fb0: virtio_gpudrmfb frame buffer device499vm-test-run-nixbot-gitlab> gitlab # [ 1.674504] systemd[1]: Finished Load Kernel Modules.500vm-test-run-nixbot-gitlab> gitlab # [ 1.680096] systemd[1]: Starting Apply Kernel Variables...501vm-test-run-nixbot-gitlab> gitlab # [ 1.684771] systemd[1]: Finished Create Static Device Nodes in /dev.502vm-test-run-nixbot-gitlab> gitlab # [ 1.688494] systemd[1]: Reached target Preparation for Local File Systems.503vm-test-run-nixbot-gitlab> gitlab # [ 1.688786] systemd[1]: Reached target Local File Systems.504vm-test-run-nixbot-gitlab> gitlab # [ 1.700845] systemd[1]: Starting Rule-based Manager for Device Events and Files...505vm-test-run-nixbot-gitlab> gitlab # [ 1.704651] systemd-modules-load[95]: Using 4 probe threads506vm-test-run-nixbot-gitlab> gitlab # [ 1.705983] systemd-modules-load[95]: Module 'virtio_balloon' is built in507vm-test-run-nixbot-gitlab> gitlab # [ 1.707224] systemd-modules-load[95]: Module 'virtio_console' is built in508vm-test-run-nixbot-gitlab> gitlab # [ 1.708484] systemd-modules-load[95]: Module 'virtio_rng' is built in509vm-test-run-nixbot-gitlab> gitlab # [ 1.709644] systemd-modules-load[95]: Inserted module 'dm_mod'510vm-test-run-nixbot-gitlab> gitlab # [ 1.710725] systemd-modules-load[95]: Inserted module 'virtio_gpu'511vm-test-run-nixbot-gitlab> gitlab # [ 1.713580] systemd[1]: Started Journal Service.512vm-test-run-nixbot-gitlab> gitlab # [ 1.715633] systemd[1]: Finished Apply Kernel Variables.513vm-test-run-nixbot-gitlab> gitlab # [ 1.719868] systemd[1]: Starting Create System Files and Directories...514vm-test-run-nixbot-gitlab> gitlab # [ 1.735731] systemd[1]: Finished Create System Files and Directories.515vm-test-run-nixbot-gitlab> gitlab # [ 1.755257] systemd-udevd[106]: Using default interface naming scheme 'v261'.516vm-test-run-nixbot-gitlab> gitlab # [ 1.778662] systemd[1]: Started Rule-based Manager for Device Events and Files.517vm-test-run-nixbot-gitlab> gitlab # [ 1.804130] systemd[1]: Starting Virtual Console Setup...518vm-test-run-nixbot-gitlab> gitlab # [ 1.872313] systemd-vconsole-setup[128]: Configuration of first virtual console was skipped, ignoring remaining ones.519vm-test-run-nixbot-gitlab> gitlab # [ 1.877249] systemd[1]: Finished Virtual Console Setup.520vm-test-run-nixbot-gitlab> gitlab # [ 2.201692] systemd[1]: Finished Coldplug All udev Devices.521vm-test-run-nixbot-gitlab> gitlab # [ 2.204264] systemd[1]: Reached target System Initialization.522vm-test-run-nixbot-gitlab> gitlab # [ 2.206749] systemd[1]: Reached target Basic System.523vm-test-run-nixbot-gitlab> gitlab # [ 2.392388] (udev-worker)[123]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.524vm-test-run-nixbot-gitlab> gitlab # [ 2.395447] (udev-worker)[123]: Network interface NamePolicy= disabled on kernel command line.525vm-test-run-nixbot-gitlab> gitlab # [ 2.397392] (udev-worker)[124]: Network interface NamePolicy= disabled on kernel command line.526vm-test-run-nixbot-gitlab> gitlab # [ 2.424648] systemd[1]: Found device /dev/disk/by-label/nixos.527vm-test-run-nixbot-gitlab> gitlab # [ 2.436220] systemd[1]: Reached target Initrd Root Device.528vm-test-run-nixbot-gitlab> gitlab # [ 2.438578] systemd[1]: Starting File System Check on /dev/disk/by-label/nixos...529vm-test-run-nixbot-gitlab> gitlab # [ 2.468936] systemd[1]: Found device /dev/disk/by-label/nix-store.530vm-test-run-nixbot-gitlab> gitlab # [ 2.485593] systemd-fsck[151]: nixos: clean, 12/65536 files, 13019/262144 blocks531vm-test-run-nixbot-gitlab> gitlab # [ 2.489190] systemd[1]: Finished File System Check on /dev/disk/by-label/nixos.532vm-test-run-nixbot-gitlab> gitlab # [ 2.581801] systemd[1]: Mounting /sysroot...533vm-test-run-nixbot-gitlab> gitlab # [ 2.623996] EXT4-fs (vda): mounted filesystem f34950e2-08e0-46a9-82c7-3f1ea3c9583a r/w with ordered data mode. Quota mode: none.534vm-test-run-nixbot-gitlab> gitlab # [ 2.621788] systemd[1]: Mounted /sysroot.535vm-test-run-nixbot-gitlab> gitlab # [ 2.623566] systemd[1]: Reached target Initrd Root File System.536vm-test-run-nixbot-gitlab> gitlab # [ 2.628342] systemd[1]: Mounting /sysroot/nix/.ro-store...537vm-test-run-nixbot-gitlab> gitlab # [ 2.631856] systemd[1]: Mounting /sysroot/nix/.rw-store...538vm-test-run-nixbot-gitlab> gitlab # [ 2.637542] systemd[1]: Mounting /sysroot/run...539vm-test-run-nixbot-gitlab> gitlab # [ 2.652326] systemd[1]: Mounting /sysroot/tmp/shared...540vm-test-run-nixbot-gitlab> gitlab # [ 2.655427] systemd[1]: Mounting /sysroot/tmp/xchg...541vm-test-run-nixbot-gitlab> gitlab # [ 2.668380] systemd[1]: Starting Mountpoints Configured in the Real Root...542vm-test-run-nixbot-gitlab> gitlab # [ 2.674226] systemd[1]: Mounted /sysroot/nix/.rw-store.543vm-test-run-nixbot-gitlab> gitlab # [ 2.692073] systemd-sysroot-fstab-check[165]: /sysroot should be mounted in the initrd, will request daemon-reload.544vm-test-run-nixbot-gitlab> gitlab # [ 2.695444] systemd[1]: Mounted /sysroot/run.545vm-test-run-nixbot-gitlab> gitlab # [ 2.711068] erofs (device vdb): mounted with root inode @ nid 128.546vm-test-run-nixbot-gitlab> gitlab # [ 2.711193] systemd[1]: Mounted /sysroot/tmp/shared.547vm-test-run-nixbot-gitlab> gitlab # [ 2.712190] systemd[1]: Mounted /sysroot/nix/.ro-store.548vm-test-run-nixbot-gitlab> gitlab # [ 2.734924] systemd[1]: Starting rw-sysroot-nix-store.service...549vm-test-run-nixbot-gitlab> gitlab # [ 2.736629] systemd[1]: Reload requested from client PID 165 ('systemd-sysroot') (unit initrd-parse-etc.service)...550vm-test-run-nixbot-gitlab> gitlab # [ 2.738468] systemd[1]: Reloading...551vm-test-run-nixbot-gitlab> gitlab # [ 2.846950] systemd[1]: Reloading finished in 110 ms.552vm-test-run-nixbot-gitlab> gitlab # [ 2.906933] systemd-sysroot-fstab-check[165]: Requesting initrd-fs.target/start/replace...553vm-test-run-nixbot-gitlab> gitlab # [ 2.908791] systemd[1]: Mounted /sysroot/tmp/xchg.554vm-test-run-nixbot-gitlab> gitlab # [ 2.909525] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.555vm-test-run-nixbot-gitlab> gitlab # [ 2.910535] systemd[1]: Finished rw-sysroot-nix-store.service.556vm-test-run-nixbot-gitlab> gitlab # [ 2.911726] systemd-sysroot-fstab-check[165]: Requesting swap.target/start/replace...557vm-test-run-nixbot-gitlab> gitlab # [ 2.914627] systemd[1]: Starting rw-sysroot-nix-store.service...558vm-test-run-nixbot-gitlab> gitlab # [ 2.915640] systemd[1]: initrd-parse-etc.service: Deactivated successfully.559vm-test-run-nixbot-gitlab> gitlab # [ 2.916707] systemd[1]: Finished Mountpoints Configured in the Real Root.560vm-test-run-nixbot-gitlab> gitlab # [ 2.917643] systemd[1]: initrd-parse-etc.service: Triggering OnSuccess= dependencies.561vm-test-run-nixbot-gitlab> gitlab # [ 2.931693] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.562vm-test-run-nixbot-gitlab> gitlab # [ 2.932942] systemd[1]: Finished rw-sysroot-nix-store.service.563vm-test-run-nixbot-gitlab> gitlab # [ 2.997779] (udev-worker)[122]: mtd0ro: Failed to find and pin callout binary "/nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/mtd_probe": No such file or directory564vm-test-run-nixbot-gitlab> gitlab # [ 3.000763] (udev-worker)[122]: mtd0ro: /nix/store/x3ma60wd3w0db1m4dr1xln72q96lnm3b-systemd-261.1/lib/udev/rules.d/75-probe_mtd.rules:5 IMPORT{program}="mtd_probe $devnode": Failed to execute "mtd_probe /dev/mtd0ro", ignoring: No such file or directory565vm-test-run-nixbot-gitlab> gitlab # [ 3.004498] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.566vm-test-run-nixbot-gitlab> gitlab # [ 3.005938] systemd[1]: Stopped Virtual Console Setup.567vm-test-run-nixbot-gitlab> gitlab # [ 3.006818] systemd[1]: Stopping Virtual Console Setup...568vm-test-run-nixbot-gitlab> gitlab # [ 3.007629] systemd[1]: Starting Virtual Console Setup...569vm-test-run-nixbot-gitlab> gitlab # [ 3.024803] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.570vm-test-run-nixbot-gitlab> gitlab # [ 3.025873] systemd[1]: Stopped Virtual Console Setup.571vm-test-run-nixbot-gitlab> gitlab # [ 3.026990] systemd[1]: Starting Virtual Console Setup...572vm-test-run-nixbot-gitlab> gitlab # [ 3.047011] systemd-vconsole-setup[198]: Configuration of first virtual console was skipped, ignoring remaining ones.573vm-test-run-nixbot-gitlab> gitlab # [ 3.049131] systemd[1]: Finished Virtual Console Setup.574vm-test-run-nixbot-gitlab> gitlab # [ 3.586985] systemd[1]: Mounting /sysroot/nix/store...575vm-test-run-nixbot-gitlab> gitlab # [ 3.680297] systemd[1]: Mounted /sysroot/nix/store.576vm-test-run-nixbot-gitlab> gitlab # [ 3.682677] systemd[1]: Reached target Initrd File Systems.577vm-test-run-nixbot-gitlab> gitlab # [ 3.686488] systemd[1]: Starting Find NixOS closure...578vm-test-run-nixbot-gitlab> gitlab # [ 3.688873] systemd[1]: Starting Create Volatile Files and Directories in the Real Root...579vm-test-run-nixbot-gitlab> gitlab # [ 3.737984] systemd[1]: Finished Create Volatile Files and Directories in the Real Root.580vm-test-run-nixbot-gitlab> gitlab # [ 3.741928] systemd[1]: sysroot-run-credentials-systemd\x2dtmpfiles\x2dsetup\x2dsysroot.service.mount: Deactivated successfully.581vm-test-run-nixbot-gitlab> gitlab # [ 3.763116] systemd[1]: Finished Find NixOS closure.582vm-test-run-nixbot-gitlab> gitlab # [ 3.765576] systemd[1]: Reached target Initrd Default Target.583vm-test-run-nixbot-gitlab> gitlab # [ 3.768195] systemd[1]: Starting Cleaning Up and Shutting Down Daemons...584vm-test-run-nixbot-gitlab> gitlab # [ 3.812946] systemd[1]: Stopped target Initrd Default Target.585vm-test-run-nixbot-gitlab> gitlab # [ 3.815567] systemd[1]: Stopped target Basic System.586vm-test-run-nixbot-gitlab> gitlab # [ 3.817876] systemd[1]: Stopped target Initrd Root Device.587vm-test-run-nixbot-gitlab> gitlab # [ 3.820304] systemd[1]: Stopped target Path Units.588vm-test-run-nixbot-gitlab> gitlab # [ 3.822426] systemd[1]: systemd-ask-password-console.path: Deactivated successfully.589vm-test-run-nixbot-gitlab> gitlab # [ 3.825678] systemd[1]: Stopped Dispatch Password Requests to Console Directory Watch.590vm-test-run-nixbot-gitlab> gitlab # [ 3.829021] systemd[1]: Stopped target Slice Units.591vm-test-run-nixbot-gitlab> gitlab # [ 3.831173] systemd[1]: Stopped target Socket Units.592vm-test-run-nixbot-gitlab> gitlab # [ 3.833396] systemd[1]: Stopped target System Initialization.593vm-test-run-nixbot-gitlab> gitlab # [ 3.839029] systemd[1]: Stopped target Swaps.594vm-test-run-nixbot-gitlab> gitlab # [ 3.843511] systemd[1]: Stopped target Timer Units.595vm-test-run-nixbot-gitlab> gitlab # [ 3.847482] systemd[1]: dbus.socket: Deactivated successfully.596vm-test-run-nixbot-gitlab> gitlab # [ 3.851872] systemd[1]: Closed D-Bus System Message Bus Socket.597vm-test-run-nixbot-gitlab> gitlab # [ 3.855453] systemd[1]: initrd-find-nixos-closure.service: Deactivated successfully.598vm-test-run-nixbot-gitlab> gitlab # [ 3.859413] systemd[1]: Stopped Find NixOS closure.599vm-test-run-nixbot-gitlab> gitlab # [ 3.862258] systemd[1]: Starting Load Kernel Module 9pnet_virtio...600vm-test-run-nixbot-gitlab> gitlab # [ 3.865038] systemd[1]: Starting rw-sysroot-nix-store.service...601vm-test-run-nixbot-gitlab> gitlab # [ 3.867491] systemd[1]: systemd-sysctl.service: Deactivated successfully.602vm-test-run-nixbot-gitlab> gitlab # [ 3.870443] systemd[1]: Stopped Apply Kernel Variables.603vm-test-run-nixbot-gitlab> gitlab # [ 3.872606] systemd[1]: systemd-modules-load.service: Deactivated successfully.604vm-test-run-nixbot-gitlab> gitlab # [ 3.875181] systemd[1]: Stopped Load Kernel Modules.605vm-test-run-nixbot-gitlab> gitlab # [ 3.877311] systemd[1]: systemd-tmpfiles-setup-sysroot.service: Deactivated successfully.606vm-test-run-nixbot-gitlab> gitlab # [ 3.880251] systemd[1]: Stopped Create Volatile Files and Directories in the Real Root.607vm-test-run-nixbot-gitlab> gitlab # [ 3.883014] systemd[1]: systemd-tmpfiles-setup.service: Deactivated successfully.608vm-test-run-nixbot-gitlab> gitlab # [ 3.885745] systemd[1]: Stopped Create System Files and Directories.609vm-test-run-nixbot-gitlab> gitlab # [ 3.887975] systemd[1]: Stopped target Local File Systems.610vm-test-run-nixbot-gitlab> gitlab # [ 3.891181] systemd[1]: Stopped target Preparation for Local File Systems.611vm-test-run-nixbot-gitlab> gitlab # [ 3.893718] systemd[1]: systemd-udev-trigger.service: Deactivated successfully.612vm-test-run-nixbot-gitlab> gitlab # [ 3.896231] systemd[1]: Stopped Coldplug All udev Devices.613vm-test-run-nixbot-gitlab> gitlab # [ 3.898259] systemd[1]: Stopping Rule-based Manager for Device Events and Files...614vm-test-run-nixbot-gitlab> gitlab # [ 3.900915] systemd[1]: systemd-vconsole-setup.service: Deactivated successfully.615vm-test-run-nixbot-gitlab> gitlab # [ 3.903468] systemd[1]: Stopped Virtual Console Setup.616vm-test-run-nixbot-gitlab> gitlab # [ 3.905388] systemd[1]: initrd-cleanup.service: Deactivated successfully.617vm-test-run-nixbot-gitlab> gitlab # [ 3.907638] systemd[1]: Finished Cleaning Up and Shutting Down Daemons.618vm-test-run-nixbot-gitlab> gitlab # [ 3.909878] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.619vm-test-run-nixbot-gitlab> gitlab # [ 3.912158] systemd[1]: Finished Load Kernel Module 9pnet_virtio.620vm-test-run-nixbot-gitlab> gitlab # [ 3.914319] systemd[1]: rw-sysroot-nix-store.service: Deactivated successfully.621vm-test-run-nixbot-gitlab> gitlab # [ 3.916409] systemd[1]: Finished rw-sysroot-nix-store.service.622vm-test-run-nixbot-gitlab> gitlab # [ 3.918072] systemd[1]: systemd-udevd.service: Deactivated successfully.623vm-test-run-nixbot-gitlab> gitlab # [ 3.919848] systemd[1]: Stopped Rule-based Manager for Device Events and Files.624vm-test-run-nixbot-gitlab> gitlab # [ 3.921858] systemd[1]: systemd-udevd.service: Consumed 2.218s CPU time over 2.182s wall clock time, 31.1M memory peak.625vm-test-run-nixbot-gitlab> gitlab # [ 3.924458] systemd[1]: systemd-udevd-control.socket: Deactivated successfully.626vm-test-run-nixbot-gitlab> gitlab # [ 3.926253] systemd[1]: Closed udev Control Socket.627vm-test-run-nixbot-gitlab> gitlab # [ 3.927452] systemd[1]: Starting Cleanup udev Database...628vm-test-run-nixbot-gitlab> gitlab # [ 3.928821] systemd[1]: systemd-tmpfiles-setup-dev.service: Deactivated successfully.629vm-test-run-nixbot-gitlab> gitlab # [ 3.930605] systemd[1]: Stopped Create Static Device Nodes in /dev.630vm-test-run-nixbot-gitlab> gitlab # [ 3.932002] systemd[1]: systemd-tmpfiles-setup-dev-early.service: Deactivated successfully.631vm-test-run-nixbot-gitlab> gitlab # [ 3.933823] systemd[1]: Stopped Create Static Device Nodes in /dev gracefully.632vm-test-run-nixbot-gitlab> gitlab # [ 3.935364] systemd[1]: kmod-static-nodes.service: Deactivated successfully.633vm-test-run-nixbot-gitlab> gitlab # [ 3.937068] systemd[1]: Stopped Create List of Static Device Nodes.634vm-test-run-nixbot-gitlab> gitlab # [ 3.985465] systemd[1]: initrd-udevadm-cleanup-db.service: Deactivated successfully.635vm-test-run-nixbot-gitlab> gitlab # [ 3.988743] systemd[1]: Finished Cleanup udev Database.636vm-test-run-nixbot-gitlab> gitlab # [ 3.991000] systemd[1]: Reached target Switch Root.637vm-test-run-nixbot-gitlab> gitlab # [ 3.993212] systemd[1]: Starting NixOS Activation...638vm-test-run-nixbot-gitlab> gitlab # [ 4.200193] initrd-nixos-activation-start[223]: booting system configuration /nix/store/wn0nzrshngiw3ja5cjwm899x0xbvn0v4-nixos-system-gitlab-test639vm-test-run-nixbot-gitlab> gitlab # [ 4.257870] initrd-nixos-activation-start[223]: running activation script...640vm-test-run-nixbot-gitlab> gitlab # [ 4.556610] initrd-nixos-activation-start[246]: setting up /etc...641vm-test-run-nixbot-gitlab> gitlab # [ 4.729956] systemd[1]: initrd-nixos-activation.service: Deactivated successfully.642vm-test-run-nixbot-gitlab> gitlab # [ 4.733390] systemd[1]: Finished NixOS Activation.643vm-test-run-nixbot-gitlab> gitlab # [ 4.735686] systemd[1]: Starting Switch Root...644vm-test-run-nixbot-gitlab> gitlab # [ 4.779009] systemd[1]: Switching root.645vm-test-run-nixbot-gitlab> gitlab # [ 4.905636] systemd-journald[94]: Received SIGTERM from PID 1 (systemd).646vm-test-run-nixbot-gitlab> gitlab # [ 5.587199] systemd[1]: systemd 261.1 running in system mode (+PAM +AUDIT -SELINUX +APPARMOR +IMA +IPE +SMACK +SECCOMP +GCRYPT -GNUTLS +OPENSSL +ACL +BLKID +CURL +ELFUTILS +FIDO2 +IDN2 +KMOD +LIBCRYPTSETUP +LIBCRYPTSETUP_PLUGINS +LIBFDISK +PCRE2 +PWQUALITY +P11KIT +QRENCODE +TPM2 +BZIP2 +LZ4 +XZ +ZLIB +ZSTD +BPF_FRAMEWORK -BTF -XKBCOMMON +UTMP +LIBARCHIVE)647vm-test-run-nixbot-gitlab> gitlab # [ 5.587366] systemd[1]: Detected virtualization qemu.648vm-test-run-nixbot-gitlab> gitlab # [ 5.587441] systemd[1]: Detected architecture arm64.649vm-test-run-nixbot-gitlab> gitlab # [ 5.587611] systemd[1]: Detected first boot.650vm-test-run-nixbot-gitlab> gitlab # [ 5.588957] systemd[1]: Initializing machine ID from random generator.651vm-test-run-nixbot-gitlab> gitlab # [ 5.846792] systemd[1]: bpf-restrict-fs: LSM BPF program attached652vm-test-run-nixbot-gitlab> gitlab # [ 5.971567] systemd[1]: Applying preset policy.653vm-test-run-nixbot-gitlab> gitlab # [ 6.148871] systemd[1]: Populated /etc with preset unit settings.654vm-test-run-nixbot-gitlab> gitlab # [ 6.300365] systemd[1]: initrd-switch-root.service: Deactivated successfully.655vm-test-run-nixbot-gitlab> gitlab # [ 6.300784] systemd[1]: Stopped initrd-switch-root.service.656vm-test-run-nixbot-gitlab> gitlab # [ 6.302959] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1.657vm-test-run-nixbot-gitlab> gitlab # [ 6.307587] systemd[1]: Created slice Slice /system/getty.658vm-test-run-nixbot-gitlab> gitlab # [ 6.313711] systemd[1]: Created slice GitLab DevOps Platform Slice.659vm-test-run-nixbot-gitlab> gitlab # [ 6.317023] systemd[1]: Created slice User and Session Slice.660vm-test-run-nixbot-gitlab> gitlab # [ 6.317561] systemd[1]: Started Dispatch Password Requests to Console Directory Watch.661vm-test-run-nixbot-gitlab> gitlab # [ 6.318234] systemd[1]: Started Forward Password Requests to Wall Directory Watch.662vm-test-run-nixbot-gitlab> gitlab # [ 6.318885] systemd[1]: Expecting device /dev/hvc0...663vm-test-run-nixbot-gitlab> gitlab # [ 6.319599] systemd[1]: Expecting device /dev/ttyAMA0...664vm-test-run-nixbot-gitlab> gitlab # [ 6.320321] systemd[1]: Reached target Local Encrypted Volumes.665vm-test-run-nixbot-gitlab> gitlab # [ 6.321046] systemd[1]: Stopped target initrd-fs.target.666vm-test-run-nixbot-gitlab> gitlab # [ 6.321745] systemd[1]: Stopped target initrd-root-fs.target.667vm-test-run-nixbot-gitlab> gitlab # [ 6.322460] systemd[1]: Stopped target initrd-switch-root.target.668vm-test-run-nixbot-gitlab> gitlab # [ 6.323186] systemd[1]: Reached target Virtual Machines and Containers.669vm-test-run-nixbot-gitlab> gitlab # [ 6.323914] systemd[1]: Reached target Path Units.670vm-test-run-nixbot-gitlab> gitlab # [ 6.324626] systemd[1]: Reached target Remote File Systems.671vm-test-run-nixbot-gitlab> gitlab # [ 6.326211] systemd[1]: Reached target Slice Units.672vm-test-run-nixbot-gitlab> gitlab # [ 6.327126] systemd[1]: Reached target Swaps.673vm-test-run-nixbot-gitlab> gitlab # [ 6.331070] systemd[1]: Listening on Query the User Interactively for a Password.674vm-test-run-nixbot-gitlab> gitlab # [ 6.335212] systemd[1]: Listening on Process Core Dump Socket.675vm-test-run-nixbot-gitlab> gitlab # [ 6.338343] systemd[1]: Listening on Credential Encryption/Decryption.676vm-test-run-nixbot-gitlab> gitlab # [ 6.342083] systemd[1]: Listening on Factory Reset Management.677vm-test-run-nixbot-gitlab> gitlab # [ 6.343522] systemd[1]: Listening on Hostname Service Socket.678vm-test-run-nixbot-gitlab> gitlab # [ 6.354146] systemd[1]: Starting Journal Log Access Socket...679vm-test-run-nixbot-gitlab> gitlab # [ 6.356159] systemd[1]: Listening on Journal Audit Socket.680vm-test-run-nixbot-gitlab> gitlab # [ 6.360196] systemd[1]: Listening on Console Output Muting Service Socket.681vm-test-run-nixbot-gitlab> gitlab # [ 6.362505] systemd[1]: Listening on Userspace Out-Of-Memory (OOM) Killer Socket.682vm-test-run-nixbot-gitlab> gitlab # [ 6.363591] systemd[1]: TPM PCR Measurements skipped, unmet condition check ConditionSecurity=measured-os683vm-test-run-nixbot-gitlab> gitlab # [ 6.364576] systemd[1]: Make TPM PCR Policy skipped, unmet condition check ConditionSecurity=measured-uki684vm-test-run-nixbot-gitlab> gitlab # [ 6.370488] systemd[1]: Listening on Disk Repartitioning Service Socket.685vm-test-run-nixbot-gitlab> gitlab # [ 6.371898] systemd[1]: Listening on udev Control Socket.686vm-test-run-nixbot-gitlab> gitlab # [ 6.373310] systemd[1]: Listening on udev Varlink Socket.687vm-test-run-nixbot-gitlab> gitlab # [ 6.382016] systemd[1]: Mounting Huge Pages File System...688vm-test-run-nixbot-gitlab> gitlab # [ 6.390151] systemd[1]: Mounting POSIX Message Queue File System...689vm-test-run-nixbot-gitlab> gitlab # [ 6.401253] systemd[1]: Mounting Kernel Debug File System...690vm-test-run-nixbot-gitlab> gitlab # [ 6.411541] systemd[1]: Mounting Kernel Trace File System...691vm-test-run-nixbot-gitlab> gitlab # [ 6.421448] systemd[1]: Starting Create List of Static Device Nodes...692vm-test-run-nixbot-gitlab> gitlab # [ 6.429916] systemd[1]: Starting Load Kernel Module 9pnet_virtio...693vm-test-run-nixbot-gitlab> gitlab # [ 6.430766] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs694vm-test-run-nixbot-gitlab> gitlab # [ 6.437197] systemd[1]: Mounting Kernel Configuration File System...695vm-test-run-nixbot-gitlab> gitlab # [ 6.438171] systemd[1]: Load Kernel Module drm skipped, unmet condition check ConditionKernelModuleLoaded=!drm696vm-test-run-nixbot-gitlab> gitlab # [ 6.439117] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore697vm-test-run-nixbot-gitlab> gitlab # [ 6.449503] systemd[1]: Starting Load Kernel Module fuse...698vm-test-run-nixbot-gitlab> gitlab # [ 6.450498] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67699vm-test-run-nixbot-gitlab> gitlab # [ 6.459956] systemd[1]: Starting Journal Service...700vm-test-run-nixbot-gitlab> gitlab # [ 6.463992] systemd[1]: Starting Load Kernel Modules...701vm-test-run-nixbot-gitlab> gitlab # [ 6.472204] systemd[1]: Starting Userspace Out-Of-Memory (OOM) Killer...702vm-test-run-nixbot-gitlab> gitlab # [ 6.481741] systemd[1]: Starting Remount Root and Kernel File Systems...703vm-test-run-nixbot-gitlab> gitlab # [ 6.484822] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os704vm-test-run-nixbot-gitlab> gitlab # [ 6.492499] systemd-journald[317]: Collecting audit messages is enabled.705vm-test-run-nixbot-gitlab> gitlab # [ 6.493380] fuse: init (API version 7.45)706vm-test-run-nixbot-gitlab> gitlab # [ 6.495445] systemd[1]: Starting Coldplug All udev Devices...707vm-test-run-nixbot-gitlab> gitlab # [ 6.504426] systemd[1]: Listening on Journal Log Access Socket.708vm-test-run-nixbot-gitlab> gitlab # [ 6.509513] systemd[1]: Mounted Huge Pages File System.709vm-test-run-nixbot-gitlab> gitlab # [ 6.510495] systemd[1]: Mounted POSIX Message Queue File System.710vm-test-run-nixbot-gitlab> gitlab # [ 6.512232] systemd[1]: Queued start job for default target Multi-User System.711vm-test-run-nixbot-gitlab> gitlab # [ 6.512421] systemd[1]: Mounted Kernel Debug File System.712vm-test-run-nixbot-gitlab> gitlab # [ 6.514001] systemd[1]: Mounted Kernel Trace File System.713vm-test-run-nixbot-gitlab> gitlab # [ 6.515079] systemd[1]: Finished Create List of Static Device Nodes.714vm-test-run-nixbot-gitlab> gitlab # [ 6.517539] systemd[1]: Unnecessary job was removed for /dev/vdb.[ 6.516031] systemd[1]: modprobe@9pnet_virtio.service: Deactivated successfully.715vm-test-run-nixbot-gitlab> gitlab # 716vm-test-run-nixbot-gitlab> gitlab # [ 6.516892] systemd[1]: Finished Load Kernel Module 9pnet_virtio.717vm-test-run-nixbot-gitlab> gitlab # [ 6.517652] systemd[1]: Started Journal Service.718vm-test-run-nixbot-gitlab> gitlab # [ 6.526329] systemd[1]: systemd-journald.service: Deactivated successfully.719vm-test-run-nixbot-gitlab> gitlab # [ 6.527559] systemd-modules-load[318]: Using 3 probe threads720vm-test-run-nixbot-gitlab> gitlab # [ 6.528523] systemd-modules-load[318]: Module 'atkbd' is built in721vm-test-run-nixbot-gitlab> gitlab # [ 6.529516] systemd-modules-load[318]: Module 'loop' is built in722vm-test-run-nixbot-gitlab> gitlab # [ 6.530881] systemd-modules-load[318]: Inserted module 'tls'723vm-test-run-nixbot-gitlab> gitlab # [ 6.537703] EXT4-fs (vda): re-mounted f34950e2-08e0-46a9-82c7-3f1ea3c9583a.724vm-test-run-nixbot-gitlab> gitlab # [ 6.535016] systemd[1]: Mounted Kernel Configuration File System.725vm-test-run-nixbot-gitlab> gitlab # [ 6.536173] systemd[1]: modprobe@fuse.service: Deactivated successfully.726vm-test-run-nixbot-gitlab> gitlab # [ 6.537982] systemd[1]: Finished Load Kernel Module fuse.727vm-test-run-nixbot-gitlab> gitlab # [ 6.538873] systemd[1]: Finished Load Kernel Modules.728vm-test-run-nixbot-gitlab> gitlab # [ 6.539958] systemd[1]: Mounting FUSE Control File System...729vm-test-run-nixbot-gitlab> gitlab # [ 6.544404] systemd[1]: Starting Firewall...730vm-test-run-nixbot-gitlab> gitlab # [ 6.545340] systemd[1]: Starting Apply Kernel Variables...731vm-test-run-nixbot-gitlab> gitlab # [ 6.546456] systemd[1]: Starting Create Static Device Nodes in /dev gracefully...732vm-test-run-nixbot-gitlab> gitlab # [ 6.560394] systemd[1]: Finished Remount Root and Kernel File Systems.733vm-test-run-nixbot-gitlab> gitlab # [ 6.561977] systemd[1]: Mounted FUSE Control File System.734vm-test-run-nixbot-gitlab> gitlab # [ 6.567941] systemd[1]: Listening on Disk Image Download Service Socket.735vm-test-run-nixbot-gitlab> gitlab # [ 6.569760] systemd-oomd[320]: No swap; memory pressure usage will be degraded736vm-test-run-nixbot-gitlab> gitlab # [ 6.575517] systemd[1]: Starting Flush Journal to Persistent Storage...737vm-test-run-nixbot-gitlab> gitlab # [ 6.576893] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore738vm-test-run-nixbot-gitlab> gitlab # [ 6.583674] systemd[1]: Starting Load/Save OS Random Seed...739vm-test-run-nixbot-gitlab> gitlab # [ 6.584710] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os740vm-test-run-nixbot-gitlab> gitlab # [ 6.586388] systemd[1]: Started Userspace Out-Of-Memory (OOM) Killer.741vm-test-run-nixbot-gitlab> gitlab # [ 6.595813] systemd-journald[317]: Received client request to flush runtime journal.742vm-test-run-nixbot-gitlab> gitlab # [ 6.619884] systemd[1]: Finished Apply Kernel Variables.743vm-test-run-nixbot-gitlab> gitlab # [ 6.622031] systemd[1]: Finished Create Static Device Nodes in /dev gracefully.744vm-test-run-nixbot-gitlab> gitlab # [ 6.623316] systemd[1]: Starting Create Static Device Nodes in /dev...745vm-test-run-nixbot-gitlab> gitlab # [ 6.624336] systemd[1]: Finished Load/Save OS Random Seed.746vm-test-run-nixbot-gitlab> gitlab # [ 6.625143] systemd[1]: Reached target First Boot Complete.747vm-test-run-nixbot-gitlab> gitlab # [ 6.625920] systemd[1]: Finished Create Static Device Nodes in /dev.748vm-test-run-nixbot-gitlab> gitlab # [ 6.626793] systemd[1]: Reached target Preparation for Local File Systems.749vm-test-run-nixbot-gitlab> gitlab # [ 6.627735] systemd[1]: Starting Rule-based Manager for Device Events and Files...750vm-test-run-nixbot-gitlab> gitlab # [ 6.628900] systemd[1]: Finished Flush Journal to Persistent Storage.751vm-test-run-nixbot-gitlab> gitlab # [ 6.685488] systemd-udevd[363]: Using default interface naming scheme 'v261'.752vm-test-run-nixbot-gitlab> gitlab # [ 6.718396] systemd[1]: Started Rule-based Manager for Device Events and Files.753vm-test-run-nixbot-gitlab> gitlab # [ 6.866212] systemd[1]: Finished Firewall.754vm-test-run-nixbot-gitlab> gitlab # [ 7.133743] systemd[1]: Finished Coldplug All udev Devices.755vm-test-run-nixbot-gitlab> gitlab # [ 7.223075] systemd[1]: Load Kernel Module configfs skipped, unmet condition check ConditionKernelModuleLoaded=!configfs756vm-test-run-nixbot-gitlab> gitlab # [ 7.293518] systemd[1]: Condition check resulted in /dev/hvc0 being skipped.757vm-test-run-nixbot-gitlab> gitlab # [ 7.312201] systemd[1]: Mounting /run/wrappers...758vm-test-run-nixbot-gitlab> gitlab # [ 7.328411] (udev-worker)[470]: Network interface NamePolicy= disabled on kernel command line.759vm-test-run-nixbot-gitlab> gitlab # [ 7.331724] systemd[1]: Condition check resulted in /dev/ttyAMA0 being skipped.760vm-test-run-nixbot-gitlab> gitlab # [ 7.365001] (udev-worker)[411]: eth1: Config file /etc/systemd/network/40-eth1.link is applied to device based on potentially unpredictable interface name.761vm-test-run-nixbot-gitlab> gitlab # [ 7.369824] systemd[1]: Mounted /run/wrappers.762vm-test-run-nixbot-gitlab> gitlab # [ 7.370985] (udev-worker)[411]: Network interface NamePolicy= disabled on kernel command line.763vm-test-run-nixbot-gitlab> gitlab # [ 7.373771] systemd[1]: Reached target Local File Systems.764vm-test-run-nixbot-gitlab> gitlab # [ 7.374996] systemd[1]: Listening on Boot Loader Control Service Socket.765vm-test-run-nixbot-gitlab> gitlab # [ 7.378506] systemd[1]: Starting register-nix-paths.service...766vm-test-run-nixbot-gitlab> gitlab # [ 7.381767] systemd[1]: Starting Create SUID/SGID Wrappers...767vm-test-run-nixbot-gitlab> gitlab # [ 7.383483] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.768vm-test-run-nixbot-gitlab> gitlab # [ 7.388279] systemd[1]: Starting Save Transient machine-id to Disk...769vm-test-run-nixbot-gitlab> gitlab # [ 7.391688] systemd[1]: Starting Create System Files and Directories...770vm-test-run-nixbot-gitlab> gitlab # [ 7.413519] systemd[1]: Condition check resulted in Virtio network device being skipped.771vm-test-run-nixbot-gitlab> gitlab # [ 7.416211] systemd[1]: Load Kernel Module efi_pstore skipped, unmet condition check ConditionKernelModuleLoaded=!efi_pstore772vm-test-run-nixbot-gitlab> gitlab # [ 7.420818] systemd[1]: Update Boot Loader Random Seed skipped, no trigger condition checks were met.773vm-test-run-nixbot-gitlab> gitlab # [ 7.427602] systemd[1]: Clear Stale Hibernate Storage Info skipped, unmet condition check ConditionPathExists=/sys/firmware/efi/efivars/HibernateLocation-8cf2644b-4b0b-428f-9387-6d876050dc67774vm-test-run-nixbot-gitlab> gitlab # [ 7.433066] systemd[1]: Platform Persistent Storage Archival skipped, unmet condition check ConditionDirectoryNotEmpty=/sys/fs/pstore775vm-test-run-nixbot-gitlab> gitlab # [ 7.434811] systemd[1]: Early TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os776vm-test-run-nixbot-gitlab> gitlab # [ 7.440283] systemd[1]: TPM SRK Setup skipped, unmet condition check ConditionSecurity=measured-os777vm-test-run-nixbot-gitlab> gitlab # [ 7.451056] systemd[1]: etc-machine\x2did.mount: Deactivated successfully.778vm-test-run-nixbot-gitlab> gitlab # [ 7.454203] systemd[1]: Finished Save Transient machine-id to Disk.779vm-test-run-nixbot-gitlab> gitlab # [ 7.459780] systemd[1]: Finished Create System Files and Directories.780vm-test-run-nixbot-gitlab> gitlab # [ 7.466291] mousedev: PS/2 mouse device common for all mice781vm-test-run-nixbot-gitlab> gitlab # [ 7.464483] systemd[1]: Starting Rebuild Journal Catalog...782vm-test-run-nixbot-gitlab> gitlab # [ 7.467163] systemd[1]: Starting Record System Boot/Shutdown in UTMP...783vm-test-run-nixbot-gitlab> gitlab # [ 7.495433] systemd[1]: Finished Record System Boot/Shutdown in UTMP.784vm-test-run-nixbot-gitlab> gitlab # [ 7.515268] systemd[1]: Finished Rebuild Journal Catalog.785vm-test-run-nixbot-gitlab> gitlab # [ 7.519370] systemd[1]: Starting Update is Completed...786vm-test-run-nixbot-gitlab> gitlab # [ 7.554493] systemd[1]: Finished Update is Completed.787vm-test-run-nixbot-gitlab> gitlab # [ 7.597011] systemd[1]: suid-sgid-wrappers.service: Deactivated successfully.788vm-test-run-nixbot-gitlab> gitlab # [ 7.599646] systemd[1]: Finished Create SUID/SGID Wrappers.789vm-test-run-nixbot-gitlab> gitlab # [ 7.600856] systemd[1]: suid-sgid-wrappers.service: Consumed 136ms CPU time over 216ms wall clock time, 6.4M memory peak, 1.9M read from disk.790vm-test-run-nixbot-gitlab> gitlab # [ 7.847263] systemd[1]: Finished register-nix-paths.service.791vm-test-run-nixbot-gitlab> gitlab # [ 7.848797] systemd[1]: Reached target System Initialization.792vm-test-run-nixbot-gitlab> gitlab # [ 7.849895] systemd[1]: Started Discard unused filesystem blocks once a week.793vm-test-run-nixbot-gitlab> gitlab # [ 7.851262] systemd[1]: Started logrotate.timer.794vm-test-run-nixbot-gitlab> gitlab # [ 7.852054] systemd[1]: Started Daily Cleanup of Temporary Directories.795vm-test-run-nixbot-gitlab> gitlab # [ 7.853013] systemd[1]: Reached target Timer Units.796vm-test-run-nixbot-gitlab> gitlab # [ 7.853735] systemd[1]: Listening on D-Bus System Message Bus Socket.797vm-test-run-nixbot-gitlab> gitlab # [ 7.854644] systemd[1]: Listening on Nix Daemon Socket.798vm-test-run-nixbot-gitlab> gitlab # [ 7.867207] systemd[1]: Starting nixbot CI service socket...799vm-test-run-nixbot-gitlab> gitlab # [ 7.868469] systemd[1]: Listening on Virtual Machine and Container Registration Service Socket.800vm-test-run-nixbot-gitlab> gitlab # [ 7.869655] systemd[1]: Listening on nixbot CI service socket.801vm-test-run-nixbot-gitlab> gitlab # [ 7.870516] systemd[1]: Reached target Socket Units.802vm-test-run-nixbot-gitlab> gitlab # [ 7.872773] systemd[1]: Starting D-Bus System Message Bus...803vm-test-run-nixbot-gitlab> gitlab # [ 7.900752] input: QEMU Virtio Keyboard as /devices/platform/4010000000.pcie/pci0000:00/0000:00:09.0/virtio8/input/input3804vm-test-run-nixbot-gitlab> gitlab # [ 7.912420] dbus-broker-launch[562]: Looking up NSS user entry for 'systemd-timesync'...805vm-test-run-nixbot-gitlab> gitlab # [ 7.914050] dbus-broker-launch[562]: NSS returned no entry for 'systemd-timesync'806vm-test-run-nixbot-gitlab> gitlab # [ 7.915077] dbus-broker-launch[562]: Invalid user-name in /nix/store/9zcyylhndlnizbwn48627991zr1jxg4p-system-path/share/dbus-1/system.d/org.freedesktop.timesync1.conf +16: user="systemd-timesync"807vm-test-run-nixbot-gitlab> gitlab # [ 7.920135] systemd[1]: Started D-Bus System Message Bus.808vm-test-run-nixbot-gitlab> gitlab # [ 7.931008] dbus-broker-launch[562]: Ready809vm-test-run-nixbot-gitlab> gitlab # [ 7.931811] systemd[1]: Reached target Basic System.810vm-test-run-nixbot-gitlab> gitlab # [ 7.936373] systemd[1]: Started backdoor.service.811vm-test-run-nixbot-gitlab> gitlab # [ 7.942969] systemd[1]: Starting gitlab-config.service...812vm-test-run-nixbot-gitlab> gitlab # [ 7.956430] systemd[1]: Starting Import lastlog data into lastlog2 database...813vm-test-run-nixbot-gitlab> gitlab # [ 7.964088] systemd[1]: Starting Logrotate configuration check...814vm-test-run-nixbot-gitlab> gitlab # [ 7.972424] systemd[1]: Starting Name Service Cache Daemon (nsncd)...815vm-test-run-nixbot-gitlab> gitlab # [ 7.980544] systemd[1]: Starting Post-Boot Actions...816vm-test-run-nixbot-gitlab> gitlab # connecting to host...817vm-test-run-nixbot-gitlab> gitlab # [ 7.987103] logrotate[568]: warning: logrotate in debug mode does nothing except printing debug messages! Consider using verbose mode (-v) instead if this is not what you want.818vm-test-run-nixbot-gitlab> gitlab # [ 7.992315] logrotate[568]: reading config file /nix/store/22afkmbkaxyx50bj9lbkkpmz7pd69hsf-logrotate.conf819vm-test-run-nixbot-gitlab> gitlab # [ 7.993706] logrotate[568]: note: 'monthly' overrides previously specified 'weekly'820vm-test-run-nixbot-gitlab> gitlab # [ 7.995222] logrotate[568]: Reading state from file: /var/lib/logrotate.status821vm-test-run-nixbot-gitlab> gitlab # [ 7.998911] logrotate[568]: state file /var/lib/logrotate.status does not exist822vm-test-run-nixbot-gitlab> gitlab # [ 7.999906] logrotate[568]: Allocating hash table for state file, size 64 entries823vm-test-run-nixbot-gitlab> gitlab: Guest shell says: b'Spawning backdoor root shell...\n'824vm-test-run-nixbot-gitlab> gitlab # [ 8.001049] logrotate[568]: Handling 4 logs825vm-test-run-nixbot-gitlab> gitlab: connected to guest root shell826vm-test-run-nixbot-gitlab> gitlab # [ 8.001697] logrotate[568]: rotating pattern: "/var/log/btmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed827vm-test-run-nixbot-gitlab> gitlab: (connecting took 8.48 seconds)828vm-test-run-nixbot-gitlab> gitlab # [ 8.003628] logrotate[568]: considering log /var/log/btmp829vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for the VM to finish booting, in 8.48 seconds)830vm-test-run-nixbot-gitlab> gitlab # [ 8.004569] logrotate[568]: Creating new state831vm-test-run-nixbot-gitlab> gitlab # [ 8.005154] logrotate[568]: Now: 2026-09-14 09:28832vm-test-run-nixbot-gitlab> gitlab # [ 8.005772] logrotate[568]: Last rotated at 2026-09-14 09:00833vm-test-run-nixbot-gitlab> gitlab # [ 8.006502] logrotate[568]: log does not need rotating (log has already been rotated)834vm-test-run-nixbot-gitlab> gitlab # [ 8.007463] logrotate[568]: rotating pattern: "/var/log/wtmp" monthly empty log files are not rotated, only log files >= 1048576 bytes are rotated, (1 rotations), old logs are removed835vm-test-run-nixbot-gitlab> gitlab # [ 8.009661] logrotate[568]: considering log /var/log/wtmp836vm-test-run-nixbot-gitlab> gitlab # [ 8.010388] logrotate[568]: Creating new state837vm-test-run-nixbot-gitlab> gitlab # [ 8.011097] logrotate[568]: Now: 2026-09-14 09:28838vm-test-run-nixbot-gitlab> gitlab # [ 8.011727] logrotate[568]: Last rotated at 2026-09-14 09:00839vm-test-run-nixbot-gitlab> gitlab # [ 8.012687] logrotate[568]: log does not need rotating (log has already been rotated)840vm-test-run-nixbot-gitlab> gitlab # [ 8.013652] logrotate[568]: rotating pattern: "/var/gitlab/state/log/*.log" after 1 days empty log files are not rotated, (30 rotations), old logs are removed841vm-test-run-nixbot-gitlab> gitlab # [ 8.015299] logrotate[568]: switching euid from 0 to 165 and egid from 0 to 165 (pid 568)842vm-test-run-nixbot-gitlab> gitlab # [ 8.016306] logrotate[568]: considering log /var/gitlab/state/log/*.log843vm-test-run-nixbot-gitlab> gitlab # [ 8.017096] logrotate[568]: log /var/gitlab/state/log/*.log does not exist -- skipping844vm-test-run-nixbot-gitlab> gitlab # [ 8.018123] logrotate[568]: Creating new state845vm-test-run-nixbot-gitlab> gitlab # [ 8.018876] logrotate[568]: switching euid from 165 to 0 and egid from 165 to 0 (pid 568)846vm-test-run-nixbot-gitlab> gitlab # [ 8.019891] logrotate[568]: rotating pattern: "/var/log/nginx/*.log" weekly empty log files are not rotated, (26 rotations), old logs are removed847vm-test-run-nixbot-gitlab> gitlab # [ 8.021625] logrotate[568]: switching euid from 0 to 60 and egid from 0 to 60 (pid 568)848vm-test-run-nixbot-gitlab> gitlab # [ 8.022661] logrotate[568]: considering log /var/log/nginx/*.log849vm-test-run-nixbot-gitlab> gitlab # [ 8.023461] logrotate[568]: log /var/log/nginx/*.log does not exist -- skipping850vm-test-run-nixbot-gitlab> gitlab # [ 8.024457] logrotate[568]: Creating new state851vm-test-run-nixbot-gitlab> gitlab # [ 8.025053] logrotate[568]: not running postrotate script, since no logs were rotated852vm-test-run-nixbot-gitlab> gitlab # [ 8.026060] logrotate[568]: switching euid from 60 to 0 and egid from 60 to 0 (pid 568)853vm-test-run-nixbot-gitlab> gitlab # [ 8.027100] systemd[1]: Started Reset console on configuration changes.854vm-test-run-nixbot-gitlab> gitlab # [ 8.028959] nsncd[569]: Sep 14 09:28:04.847 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"855vm-test-run-nixbot-gitlab> gitlab # [ 8.037501] systemd[1]: Starting resolvconf update...856vm-test-run-nixbot-gitlab> gitlab # [ 8.039614] systemd[1]: Started Name Service Cache Daemon (nsncd).857vm-test-run-nixbot-gitlab> gitlab # [ 8.064212] systemd[1]: Finished Logrotate configuration check.858vm-test-run-nixbot-gitlab> gitlab # [ 8.065382] systemd[1]: Finished Post-Boot Actions.859vm-test-run-nixbot-gitlab> gitlab # [ 8.066999] systemd[1]: Finished Import lastlog data into lastlog2 database.860vm-test-run-nixbot-gitlab> gitlab # [ 8.088112] systemd[1]: Reached target Host and Network Name Lookups.861vm-test-run-nixbot-gitlab> gitlab # [ 8.089049] systemd[1]: Reached target User and Group Name Lookups.862vm-test-run-nixbot-gitlab> gitlab # [ 8.094100] systemd[1]: Starting User Login Management...863vm-test-run-nixbot-gitlab> gitlab # [ 8.095639] systemd[1]: Starting Virtual Console Setup...864vm-test-run-nixbot-gitlab> gitlab # [ 8.137330] systemd[1]: Stopped target Host and Network Name Lookups.865vm-test-run-nixbot-gitlab> gitlab # [ 8.138612] systemd[1]: Stopping Host and Network Name Lookups...866vm-test-run-nixbot-gitlab> gitlab # [ 8.139952] systemd[1]: Stopped target User and Group Name Lookups.867vm-test-run-nixbot-gitlab> gitlab # [ 8.141470] systemd[1]: Stopping User and Group Name Lookups...868vm-test-run-nixbot-gitlab> gitlab # [ 8.142634] systemd[1]: Stopping Name Service Cache Daemon (nsncd)...869vm-test-run-nixbot-gitlab> gitlab # [ 8.144037] systemd[1]: nscd.service: Deactivated successfully.870vm-test-run-nixbot-gitlab> gitlab # [ 8.145297] systemd[1]: Stopped Name Service Cache Daemon (nsncd).871vm-test-run-nixbot-gitlab> gitlab # [ 8.146529] systemd[1]: nscd.service: Consumed 30ms CPU time over 170ms wall clock time, 7.7M memory peak, 5.8M read from disk.872vm-test-run-nixbot-gitlab> gitlab # [ 8.149875] systemd-logind[617]: New seat seat0.873vm-test-run-nixbot-gitlab> gitlab # [ 8.150948] systemd[1]: Starting Name Service Cache Daemon (nsncd)...874vm-test-run-nixbot-gitlab> gitlab # [ 8.157878] systemd-logind[617]: Watching system buttons on /dev/input/event3 (QEMU Virtio Keyboard)875vm-test-run-nixbot-gitlab> gitlab # [ 8.159186] systemd-logind[617]: Watching system buttons on /dev/input/event1 (QEMU QEMU USB Keyboard)876vm-test-run-nixbot-gitlab> gitlab # [ 8.161406] systemd-logind[617]: Watching system buttons on /dev/input/event0 (gpio-keys)877vm-test-run-nixbot-gitlab> gitlab # [ 8.162684] systemd[1]: Started User Login Management.878vm-test-run-nixbot-gitlab> gitlab # [ 8.168197] systemd-vconsole-setup[620]: Configuration of first virtual console was skipped, ignoring remaining ones.879vm-test-run-nixbot-gitlab> gitlab # [ 8.170850] systemd[1]: Starting linger-users.service...880vm-test-run-nixbot-gitlab> gitlab # [ 8.172947] systemd[1]: Finished Virtual Console Setup.881vm-test-run-nixbot-gitlab> gitlab # [ 8.181224] systemd[1]: Started Name Service Cache Daemon (nsncd).882vm-test-run-nixbot-gitlab> gitlab # [ 8.182201] systemd[1]: Reached target Host and Network Name Lookups.883vm-test-run-nixbot-gitlab> gitlab # [ 8.183539] nsncd[666]: Sep 14 09:28:05.019 INFO started, config: Config { ignored_request_types: {}, worker_count: 8, handoff_timeout: 10s }, path: "/var/run/nscd/socket"884vm-test-run-nixbot-gitlab> gitlab # [ 8.185931] systemd[1]: Reached target User and Group Name Lookups.885vm-test-run-nixbot-gitlab> gitlab # [ 8.187573] systemd[1]: linger-users.service: Deactivated successfully.886vm-test-run-nixbot-gitlab> gitlab # [ 8.188565] systemd[1]: Finished linger-users.service.887vm-test-run-nixbot-gitlab> gitlab # [ 8.191255] systemd[1]: Finished resolvconf update.888vm-test-run-nixbot-gitlab> gitlab # [ 8.191986] systemd[1]: Reached target Preparation for Network.889vm-test-run-nixbot-gitlab> gitlab # [ 8.195409] systemd[1]: Starting DHCP Client...890vm-test-run-nixbot-gitlab> gitlab # [ 8.197924] systemd[1]: Starting Address configuration of eth1...891vm-test-run-nixbot-gitlab> gitlab # [ 8.200537] systemd[1]: Starting Extra networking commands....892vm-test-run-nixbot-gitlab> gitlab # [ 8.247587] network-addresses-eth1-start[692]: adding address 192.168.1.1/24... done893vm-test-run-nixbot-gitlab> gitlab # [ 8.250715] network-addresses-eth1-start[692]: adding address 2001:db8:1::1/64... done894vm-test-run-nixbot-gitlab> gitlab # [ 8.259289] systemd[1]: Finished Address configuration of eth1.895vm-test-run-nixbot-gitlab> gitlab # [ 8.289963] dhcpcd[703]: dhcpcd-10.3.2 starting896vm-test-run-nixbot-gitlab> gitlab # [ 8.291915] dhcpcd[753]: dev: loaded udev897vm-test-run-nixbot-gitlab> gitlab # [ 8.301813] systemd[1]: Finished Extra networking commands..898vm-test-run-nixbot-gitlab> gitlab # [ 8.302684] systemd[1]: Reached target Network.899vm-test-run-nixbot-gitlab> gitlab # [ 8.308556] 8021q: 802.1Q VLAN Support v1.8900vm-test-run-nixbot-gitlab> gitlab # [ 8.308961] 8021q: adding VLAN 0 to HW filter on device eth1901vm-test-run-nixbot-gitlab> gitlab # [ 8.306033] systemd[1]: Starting gitlab-workhorse.service...902vm-test-run-nixbot-gitlab> gitlab # [ 8.310568] systemd[1]: Starting Nginx Web Server...903vm-test-run-nixbot-gitlab> gitlab # [ 8.319039] systemd[1]: Starting PostgreSQL Server...904vm-test-run-nixbot-gitlab> gitlab # [ 8.320700] systemd[1]: Starting Redis Server - redis-gitlab...905vm-test-run-nixbot-gitlab> gitlab # [ 8.328488] systemd[1]: Starting Permit User Sessions...906vm-test-run-nixbot-gitlab> gitlab # [ 8.337575] systemd[1]: Listening on Load/Save RF Kill Switch Status /dev/rfkill Watch.907vm-test-run-nixbot-gitlab> gitlab # [ 8.353779] cfg80211: Loading compiled-in X.509 certificates for regulatory database908vm-test-run-nixbot-gitlab> gitlab # [ 8.359104] Loaded X.509 cert 'sforshee: 00b28ddf47aef9cea7'909vm-test-run-nixbot-gitlab> gitlab # [ 8.359596] Loaded X.509 cert 'wens: 61c038651aabdcf94bd0ac7ff06c7248db18c600'910vm-test-run-nixbot-gitlab> gitlab # [ 8.365394] faux_driver regulatory: Direct firmware load for regulatory.db failed with error -2911vm-test-run-nixbot-gitlab> gitlab # [ 8.365719] cfg80211: failed to load regulatory.db912vm-test-run-nixbot-gitlab> gitlab # [ 8.368624] systemd[1]: Finished Permit User Sessions.913vm-test-run-nixbot-gitlab> gitlab # [ 8.374711] systemd[1]: Started Getty on tty1.914vm-test-run-nixbot-gitlab> gitlab # [ 8.379223] systemd[1]: Reached target Login Prompts.915vm-test-run-nixbot-gitlab> gitlab # [ 8.416088] 8021q: adding VLAN 0 to HW filter on device eth0916vm-test-run-nixbot-gitlab> gitlab # [ 8.412883] dhcpcd[753]: eth0: waiting for carrier917vm-test-run-nixbot-gitlab> gitlab # [ 8.413686] dhcpcd[753]: eth0: carrier acquired918vm-test-run-nixbot-gitlab> gitlab # [ 8.416867] dhcpcd[753]: DUID 00:01:00:01:32:3a:7a:a5:52:54:00:12:34:56919vm-test-run-nixbot-gitlab> gitlab # [ 8.418093] dhcpcd[753]: eth0: IAID 00:12:34:56920vm-test-run-nixbot-gitlab> gitlab # [ 8.418780] dhcpcd[753]: eth0: adding address fe80::5054:ff:fe12:3456921vm-test-run-nixbot-gitlab> gitlab # [ 8.486000] nginx-pre-start[795]: nginx: the configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf syntax is ok922vm-test-run-nixbot-gitlab> gitlab # [ 8.488544] nginx-pre-start[795]: nginx: configuration file /nix/store/ybdwy2xmslvjmdkxgrrhy1x5rwh45z0q-nginx.conf test is successful923vm-test-run-nixbot-gitlab> gitlab # [ 8.490572] systemd[1]: Started Nginx Web Server.924vm-test-run-nixbot-gitlab> gitlab # [ 8.515891] postgresql-pre-start[796]: The files belonging to this database system will be owned by user "postgres".925vm-test-run-nixbot-gitlab> gitlab # [ 8.517937] postgresql-pre-start[796]: This user must also own the server process.926vm-test-run-nixbot-gitlab> gitlab # [ 8.519417] postgresql-pre-start[796]: The database cluster will be initialized with locale "en_US.UTF-8".927vm-test-run-nixbot-gitlab> gitlab # [ 8.521279] postgresql-pre-start[796]: The default database encoding has accordingly been set to "UTF8".928vm-test-run-nixbot-gitlab> gitlab # [ 8.526493] postgresql-pre-start[796]: The default text search configuration will be set to "english".929vm-test-run-nixbot-gitlab> gitlab # [ 8.527906] postgresql-pre-start[796]: Data page checksums are enabled.930vm-test-run-nixbot-gitlab> gitlab # [ 8.529056] postgresql-pre-start[796]: fixing permissions on existing directory /var/lib/postgresql/18 ... ok931vm-test-run-nixbot-gitlab> gitlab # [ 8.530427] postgresql-pre-start[796]: creating subdirectories ... ok932vm-test-run-nixbot-gitlab> gitlab # [ 8.531302] postgresql-pre-start[796]: selecting dynamic shared memory implementation ... posix933vm-test-run-nixbot-gitlab> gitlab # [ 8.532876] systemd[1]: Started Redis Server - redis-gitlab.934vm-test-run-nixbot-gitlab> gitlab # [ 8.533956] redis-server[792]: Supervised by systemd. Please make sure you set appropriate values for TimeoutStartSec and TimeoutStopSec in your service unit.935vm-test-run-nixbot-gitlab> gitlab # [ 8.535905] redis-server[792]: oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo936vm-test-run-nixbot-gitlab> gitlab # [ 8.537752] redis-server[792]: Redis version=8.8.1, bits=64, commit=00000000, modified=0, pid=792, just started937vm-test-run-nixbot-gitlab> gitlab # [ 8.539324] redis-server[792]: Configuration loaded938vm-test-run-nixbot-gitlab> gitlab # [ 8.540363] redis[792]: monotonic clock: ARM CNTVCT @ 1000 ticks/us939vm-test-run-nixbot-gitlab> gitlab # [ 8.541620] redis[792]: Running mode=standalone, port=0.940vm-test-run-nixbot-gitlab> gitlab # [ 8.542568] redis[792]: Server initialized941vm-test-run-nixbot-gitlab> gitlab # [ 8.543356] redis[792]: Ready to accept connections unix942vm-test-run-nixbot-gitlab> gitlab # [ 8.544385] redis[792]: WARNING: Redis does not require authentication. Redis will accept connections from any local client.943vm-test-run-nixbot-gitlab> gitlab # [ 8.572160] postgresql-pre-start[796]: selecting default "max_connections" ... 100944vm-test-run-nixbot-gitlab> gitlab # [ 8.631737] postgresql-pre-start[796]: selecting default "shared_buffers" ... 128MB945vm-test-run-nixbot-gitlab> gitlab # [ 8.904317] systemd[1]: Started gitlab-workhorse.service.946vm-test-run-nixbot-gitlab> gitlab # [ 9.111457] postgresql-pre-start[796]: selecting default time zone ... UTC947vm-test-run-nixbot-gitlab> gitlab # [ 9.114324] postgresql-pre-start[796]: creating configuration files ... ok948vm-test-run-nixbot-gitlab> gitlab # [ 9.149047] gitlab-workhorse[819]: time="2026-09-14T09:28:05Z" level=info msg=Starting build_time=19700101.000000 version=19.0.4949vm-test-run-nixbot-gitlab> gitlab # [ 9.150566] gitlab-workhorse[819]: time="2026-09-14T09:28:05Z" level=info msg="Using redis/go-redis"950vm-test-run-nixbot-gitlab> gitlab # [ 9.151745] gitlab-workhorse[819]: time="2026-09-14T09:28:05Z" level=info msg="Running upstream server" address=/run/gitlab/gitlab-workhorse.socket network=unix951vm-test-run-nixbot-gitlab> gitlab # [ 9.364314] postgresql-pre-start[796]: running bootstrap script ... ok952vm-test-run-nixbot-gitlab> gitlab # [ 9.368592] dhcpcd[753]: eth0: soliciting a DHCP lease953vm-test-run-nixbot-gitlab> gitlab # [ 9.393002] dhcpcd[753]: eth0: offered 10.0.2.15 from 10.0.2.2954vm-test-run-nixbot-gitlab> gitlab # [ 9.408537] dhcpcd[753]: eth0: probing address 10.0.2.15/24955vm-test-run-nixbot-gitlab> gitlab # [ 10.002819] postgresql-pre-start[796]: performing post-bootstrap initialization ... ok956vm-test-run-nixbot-gitlab> gitlab # [ 10.284970] dhcpcd[753]: eth0: soliciting an IPv6 router957vm-test-run-nixbot-gitlab> gitlab # [ 10.287089] dhcpcd[753]: eth0: Router Advertisement from fe80::2958vm-test-run-nixbot-gitlab> gitlab # [ 10.289163] dhcpcd[753]: eth0: adding address fec0::5054:ff:fe12:3456/64959vm-test-run-nixbot-gitlab> gitlab # [ 10.291312] dhcpcd[753]: eth0: adding route to fec0::/64960vm-test-run-nixbot-gitlab> gitlab # [ 10.293084] dhcpcd[753]: eth0: adding default route via fe80::2961vm-test-run-nixbot-gitlab> gitlab # [ 10.358358] postgresql-pre-start[796]: syncing data to disk ... ok962vm-test-run-nixbot-gitlab> gitlab # [ 10.361210] postgresql-pre-start[796]: initdb: warning: enabling "trust" authentication for local connections963vm-test-run-nixbot-gitlab> gitlab # [ 10.365400] postgresql-pre-start[796]: initdb: hint: You can change this by editing pg_hba.conf or using the option -A, or --auth-local and --auth-host, the next time you run initdb.964vm-test-run-nixbot-gitlab> gitlab # [ 10.372193] postgresql-pre-start[796]: Success. You can now start the database server using:965vm-test-run-nixbot-gitlab> gitlab # [ 10.375936] postgresql-pre-start[796]: pg_ctl -D /var/lib/postgresql/18 -l logfile start966vm-test-run-nixbot-gitlab> gitlab # [ 10.562812] postgres[852]: [852] LOG: starting PostgreSQL 18.4 on aarch64-unknown-linux-gnu, compiled by clang version 21.1.8, 64-bit967vm-test-run-nixbot-gitlab> gitlab # [ 10.568513] postgres[852]: [852] LOG: listening on IPv6 address "::1", port 5432968vm-test-run-nixbot-gitlab> gitlab # [ 10.571864] postgres[852]: [852] LOG: listening on IPv4 address "127.0.0.1", port 5432969vm-test-run-nixbot-gitlab> gitlab # [ 10.576829] postgres[852]: [852] LOG: listening on Unix socket "/run/postgresql/.s.PGSQL.5432"970vm-test-run-nixbot-gitlab> gitlab # [ 10.583400] postgres[862]: [862] LOG: database system was shut down at 2026-09-14 09:28:06 GMT971vm-test-run-nixbot-gitlab> gitlab # [ 10.591796] postgres[852]: [852] LOG: database system is ready to accept connections972vm-test-run-nixbot-gitlab> gitlab # [ 10.598540] systemd[1]: Started PostgreSQL Server.973vm-test-run-nixbot-gitlab> gitlab # [ 10.610560] systemd[1]: Starting PostgreSQL Setup Scripts...974vm-test-run-nixbot-gitlab> gitlab # [ 10.943491] postgresql-setup-start[873]: CREATE DATABASE975vm-test-run-nixbot-gitlab> gitlab # [ 11.001143] postgresql-setup-start[883]: CREATE ROLE976vm-test-run-nixbot-gitlab> gitlab # [ 11.022287] postgresql-setup-start[885]: ALTER DATABASE977vm-test-run-nixbot-gitlab> gitlab # [ 11.061115] postgresql-setup-start[890]: CREATE ROLE978vm-test-run-nixbot-gitlab> gitlab # [ 11.068459] systemd[1]: Finished PostgreSQL Setup Scripts.979vm-test-run-nixbot-gitlab> gitlab # [ 11.070855] systemd[1]: Reached target PostgreSQL.980vm-test-run-nixbot-gitlab> gitlab # [ 11.077691] systemd[1]: Starting gitlab-postgresql.service...981vm-test-run-nixbot-gitlab> gitlab # [ 11.094779] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[878]: mkdir -p /var/gitlab/state/home/.ssh: OK982vm-test-run-nixbot-gitlab> gitlab # [ 11.099028] kmklqy2bdnfisygngf3cnp8jwzlh0j09-gitlab-config[878]: chmod 700 /var/gitlab/state/home/.ssh: OK983vm-test-run-nixbot-gitlab> gitlab # [ 11.202966] systemd[1]: Finished gitlab-config.service.984vm-test-run-nixbot-gitlab> gitlab # [ 11.209643] systemd[1]: Started gitaly.service.985vm-test-run-nixbot-gitlab> gitlab # [ 11.219044] systemd[1]: Starting gitlab-db-config.service...986vm-test-run-nixbot-gitlab> gitlab # [ 11.282009] gitlab-postgresql-start[904]: CREATE DATABASE987vm-test-run-nixbot-gitlab> gitlab # [ 11.353868] gitlab-postgresql-start[927]: CREATE EXTENSION988vm-test-run-nixbot-gitlab> gitlab # [ 11.471800] gitlab-postgresql-start[930]: CREATE EXTENSION989vm-test-run-nixbot-gitlab> gitlab # [ 11.476051] systemd[1]: Finished gitlab-postgresql.service.990vm-test-run-nixbot-gitlab> gitlab # [ 11.835609] gitaly[912]: time="2026-09-14T09:28:08.671Z" level=warning msg="The current configurations will cause Gitaly to fail to start up in future versions. Please run 'gitaly configuration validate < /nix/store/0r0qd84zrxhqq373hk9spv8j9pg0qlnq-gitaly.toml' and fix the errors that are printed." pid=912991vm-test-run-nixbot-gitlab> gitlab # [ 11.848245] gitaly[912]: time="2026-09-14T09:28:08.671Z" level=info msg="maxprocs: Leaving GOMAXPROCS=4: CPU quota undefined" pid=912992vm-test-run-nixbot-gitlab> gitlab # [ 11.854179] gitaly[912]: time="2026-09-14T09:28:08.671Z" level=info msg="grpc prometheus histograms enabled" latencies="[0.001 0.005 0.025 0.1 0.5 1 10 30 60 300 1500]" pid=912993vm-test-run-nixbot-gitlab> gitlab # [ 11.860741] gitaly[912]: time="2026-09-14T09:28:08.671Z" level=error msg="error initializing distributed tracing" error="tracing is disabled" pid=912994vm-test-run-nixbot-gitlab> gitlab # [ 11.866219] gitaly[912]: time="2026-09-14T09:28:08.671Z" level=info msg="Starting Gitaly" pid=912 version=995vm-test-run-nixbot-gitlab> gitlab # [ 12.052387] gitaly[912]: time="2026-09-14T09:28:08.889Z" level=info msg="finished unpacking auxiliary binaries" duration_ms=217 pid=912996vm-test-run-nixbot-gitlab> gitlab # [ 12.055667] gitaly[912]: time="2026-09-14T09:28:08.889Z" level=info msg="finished initializing bootstrap" duration_ms=0 pid=912997vm-test-run-nixbot-gitlab> gitlab # [ 12.058477] gitaly[912]: time="2026-09-14T09:28:08.889Z" level=info msg="finished initializing command factory" duration_ms=0 pid=912998vm-test-run-nixbot-gitlab> gitlab # [ 12.061354] gitaly[912]: time="2026-09-14T09:28:08.889Z" level=info msg="using Git binary" binary_path=/run/gitaly/gitaly-912/git-exec-2431042115.d/git pid=912999vm-test-run-nixbot-gitlab> gitlab # [ 12.064745] gitaly[912]: time="2026-09-14T09:28:08.894Z" level=info msg="finished detecting git version" duration_ms=4 pid=9121000vm-test-run-nixbot-gitlab> gitlab # [ 12.067395] gitaly[912]: time="2026-09-14T09:28:08.894Z" level=info msg="using Git version" pid=912 version=2.53.g1001vm-test-run-nixbot-gitlab> gitlab # [ 12.069885] gitaly[912]: time="2026-09-14T09:28:08.894Z" level=info msg="clearing disk cache object folder" pid=912 storage=default1002vm-test-run-nixbot-gitlab> gitlab # [ 12.072632] gitaly[912]: time="2026-09-14T09:28:08.894Z" level=info msg="moving disk cache object folder" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache280370924 pid=912 storage=default1003vm-test-run-nixbot-gitlab> gitlab # [ 12.076963] gitaly[912]: time="2026-09-14T09:28:08.894Z" level=info msg="disk cache object folder doesn't exist, no need to remove" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache280370924 pid=912 storage=default1004vm-test-run-nixbot-gitlab> gitlab # [ 12.083840] gitaly[912]: time="2026-09-14T09:28:08.895Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/cache path=/var/gitlab/state/repositories/+gitaly/cache pid=9121005vm-test-run-nixbot-gitlab> gitlab # [ 12.088825] gitaly[912]: time="2026-09-14T09:28:08.895Z" level=info msg="Starting file walker" disk_cache_path=/var/gitlab/state/repositories/+gitaly/state path=/var/gitlab/state/repositories/+gitaly/state pid=9121006vm-test-run-nixbot-gitlab> gitlab # [ 12.093352] gitaly[912]: time="2026-09-14T09:28:08.895Z" level=info msg="cleared all cache object files" cache_directory=/var/gitlab/state/repositories/+gitaly/tmp/diskcache280370924 clear_duration_ms=0 pid=912 storage=default1007vm-test-run-nixbot-gitlab> gitlab # [ 12.098553] gitaly[912]: time="2026-09-14T09:28:08.920Z" level=info msg="counting repositories" pid=9121008vm-test-run-nixbot-gitlab> gitlab # [ 12.100973] gitaly[912]: time="2026-09-14T09:28:08.920Z" level=info msg="finished tempdir cleaner walk" pid=912 storage=default time_ms=01009vm-test-run-nixbot-gitlab> gitlab # [ 12.103904] gitaly[912]: time="2026-09-14T09:28:08.920Z" level=info msg="starting to count repositories" pid=912 storage_path=/var/gitlab/state/repositories1010vm-test-run-nixbot-gitlab> gitlab # [ 12.107576] gitaly[912]: time="2026-09-14T09:28:08.920Z" level=info msg="completed counting repositories" counting_duration_ms=0 pid=912 storage_path=/var/gitlab/state/repositories1011vm-test-run-nixbot-gitlab> gitlab # [ 12.111651] gitaly[912]: time="2026-09-14T09:28:08.920Z" level=warning msg="Unable to set SO_REUSEPORT: zero downtime upgrades will not work" error="operation not supported" pid=9121012vm-test-run-nixbot-gitlab> gitlab # [ 12.115820] gitaly[912]: time="2026-09-14T09:28:08.920Z" level=info msg="listening at address" address=/var/gitlab/state/tmp/sockets/gitaly.socket pid=912 schema=unix1013vm-test-run-nixbot-gitlab> gitlab # [ 12.119690] gitaly[912]: time="2026-09-14T09:28:08.920Z" level=info msg="listening at address" address=/run/gitaly/gitaly-912/sock.d/intern pid=912 schema=unix1014vm-test-run-nixbot-gitlab> gitlab # [ 12.123493] gitaly[912]: time="2026-09-14T09:28:08.920Z" level=info msg="completed counting all repositories" counting_duration=0 pid=9121015vm-test-run-nixbot-gitlab> gitlab # [ 12.127001] gitaly[912]: time="2026-09-14T09:28:08.921Z" level=info msg="starting prometheus listener" address="localhost:9236" pid=9121016vm-test-run-nixbot-gitlab> gitlab # [ 12.130398] gitaly[912]: time="2026-09-14T09:28:08.921Z" level=info msg="Started Gitaly" duration_ms=249 pid=9121017vm-test-run-nixbot-gitlab> gitlab # [ 12.133289] gitaly[912]: time="2026-09-14T09:28:08.921Z" level=info msg="Gitaly graceful stop timeout duration" duration_s=1m0s pid=9121018vm-test-run-nixbot-gitlab> gitlab # [ 12.136606] gitaly[912]: time="2026-09-14T09:28:08.922Z" level=info msg="maintenance: daily scheduled" pid=912 scheduled="2026-09-14 12:00:00 +0000 UTC"1019vm-test-run-nixbot-gitlab> gitlab # [ 12.505166] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[919]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1020vm-test-run-nixbot-gitlab> gitlab # [ 12.515527] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[919]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1021vm-test-run-nixbot-gitlab> gitlab # [ 12.525730] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[919]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1022vm-test-run-nixbot-gitlab> gitlab # [ 14.461232] dhcpcd[753]: eth0: leased 10.0.2.15 for 86400 seconds1023vm-test-run-nixbot-gitlab> gitlab # [ 14.461602] dhcpcd[753]: eth0: adding route to 10.0.2.0/241024vm-test-run-nixbot-gitlab> gitlab # [ 14.461758] dhcpcd[753]: eth0: adding default route via 10.0.2.21025vm-test-run-nixbot-gitlab> gitlab # [ 14.666723] systemd[1]: Started DHCP Client.1026vm-test-run-nixbot-gitlab> gitlab # [ 14.668104] systemd[1]: Reached target Network is Online.1027vm-test-run-nixbot-gitlab> gitlab # [ 15.430245] gitaly[912]: time="2026-09-14T09:28:12.266Z" level=info msg="License database preloaded" duration_ms=3594 pid=9121028vm-test-run-nixbot-gitlab> gitlab # [ 57.317290] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[919]: W, [2026-09-14T09:28:54.152482 #919] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1029vm-test-run-nixbot-gitlab> gitlab # [ 59.226159] gitlab-workhorse[819]: time="2026-09-14T09:28:56Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1030vm-test-run-nixbot-gitlab> gitlab # [ 60.507629] postgres[1433]: [1433] ERROR: relation "feature_gates" does not exist at character 5231031vm-test-run-nixbot-gitlab> gitlab # [ 60.507866] postgres[1433]: [1433] STATEMENT: SELECT a.attname, format_type(a.atttypid, a.atttypmod),1032vm-test-run-nixbot-gitlab> gitlab # [ 60.507922] postgres[1433]: pg_get_expr(d.adbin, d.adrelid), a.attnotnull, a.atttypid, a.atttypmod,1033vm-test-run-nixbot-gitlab> gitlab # [ 60.507967] postgres[1433]: c.collname, col_description(a.attrelid, a.attnum) AS comment,1034vm-test-run-nixbot-gitlab> gitlab # [ 60.508051] postgres[1433]: attidentity AS identity,1035vm-test-run-nixbot-gitlab> gitlab # [ 60.508102] postgres[1433]: attgenerated as attgenerated1036vm-test-run-nixbot-gitlab> gitlab # [ 60.508145] postgres[1433]: FROM pg_attribute a1037vm-test-run-nixbot-gitlab> gitlab # [ 60.508205] postgres[1433]: LEFT JOIN pg_attrdef d ON a.attrelid = d.adrelid AND a.attnum = d.adnum1038vm-test-run-nixbot-gitlab> gitlab # [ 60.508252] postgres[1433]: LEFT JOIN pg_type t ON a.atttypid = t.oid1039vm-test-run-nixbot-gitlab> gitlab # [ 60.508296] postgres[1433]: LEFT JOIN pg_collation c ON a.attcollation = c.oid AND a.attcollation <> t.typcollation1040vm-test-run-nixbot-gitlab> gitlab # [ 60.508345] postgres[1433]: WHERE a.attrelid = '"feature_gates"'::regclass1041vm-test-run-nixbot-gitlab> gitlab # [ 60.508393] postgres[1433]: AND a.attnum > 0 AND NOT a.attisdropped1042vm-test-run-nixbot-gitlab> gitlab # [ 60.508434] postgres[1433]: ORDER BY a.attnum1043vm-test-run-nixbot-gitlab> gitlab # [ 60.508482] postgres[1433]:1044vm-test-run-nixbot-gitlab> gitlab # [ 67.003545] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1498]: psql:/var/gitlab/state/db/structure.sql:9: NOTICE: extension "btree_gist" already exists, skipping1045vm-test-run-nixbot-gitlab> gitlab # [ 67.004074] b834zvbgv5v11acriba6350sglax02bw-gitlab-db-config[1498]: psql:/var/gitlab/state/db/structure.sql:11: NOTICE: extension "pg_trgm" already exists, skipping1046vm-test-run-nixbot-gitlab> gitlab # [ 69.234346] gitlab-workhorse[819]: time="2026-09-14T09:29:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1047vm-test-run-nixbot-gitlab> gitlab # [ 79.242767] gitlab-workhorse[819]: time="2026-09-14T09:29:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1048vm-test-run-nixbot-gitlab> gitlab # [ 89.250480] gitlab-workhorse[819]: time="2026-09-14T09:29:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1049vm-test-run-nixbot-gitlab> gitlab # [ 92.684280] postgres[1592]: [1592] ERROR: relation "table_without_models" does not exist1050vm-test-run-nixbot-gitlab> gitlab # [ 92.687604] postgres[1592]: [1592] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1051vm-test-run-nixbot-gitlab> gitlab # [ 99.258900] gitlab-workhorse[819]: time="2026-09-14T09:29:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1052vm-test-run-nixbot-gitlab> gitlab # [ 109.268678] gitlab-workhorse[819]: time="2026-09-14T09:29:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1053vm-test-run-nixbot-gitlab> gitlab # [ 119.278358] gitlab-workhorse[819]: time="2026-09-14T09:29:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1054vm-test-run-nixbot-gitlab> gitlab # [ 124.487344] systemd[1]: Finished gitlab-db-config.service.1055vm-test-run-nixbot-gitlab> gitlab # [ 124.494402] systemd[1]: Started gitlab-sidekiq.service.1056vm-test-run-nixbot-gitlab> gitlab # [ 124.499650] systemd[1]: Starting gitlab.service...1057vm-test-run-nixbot-gitlab> gitlab # [ 125.069654] bundle[1985]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1058vm-test-run-nixbot-gitlab> gitlab # [ 125.075968] bundle[1985]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1059vm-test-run-nixbot-gitlab> gitlab # [ 125.081859] bundle[1985]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1060vm-test-run-nixbot-gitlab> gitlab # [ 129.282809] gitlab-workhorse[819]: time="2026-09-14T09:30:06Z" level=error correlation_id= duration_ms=1 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1061vm-test-run-nixbot-gitlab> gitlab # [ 129.715022] bundle[1985]: {"timestamp":"2026-09-14T09:30:06.523Z","pid":1985,"message":"* Enabling systemd notification integration"}1062vm-test-run-nixbot-gitlab> gitlab # [ 129.720224] bundle[1985]: {"timestamp":"2026-09-14T09:30:06.551Z","pid":1985,"message":"Puma starting in cluster mode..."}1063vm-test-run-nixbot-gitlab> gitlab # [ 129.724874] bundle[1985]: {"timestamp":"2026-09-14T09:30:06.551Z","pid":1985,"message":"* Puma version: 8.0.1 (\"Into the Arena\")"}1064vm-test-run-nixbot-gitlab> gitlab # [ 129.729624] bundle[1985]: {"timestamp":"2026-09-14T09:30:06.551Z","pid":1985,"message":"* Ruby version: ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1065vm-test-run-nixbot-gitlab> gitlab # [ 129.735441] bundle[1985]: {"timestamp":"2026-09-14T09:30:06.551Z","pid":1985,"message":"* Min threads: 0"}1066vm-test-run-nixbot-gitlab> gitlab # [ 129.739381] bundle[1985]: {"timestamp":"2026-09-14T09:30:06.551Z","pid":1985,"message":"* Max threads: 4"}1067vm-test-run-nixbot-gitlab> gitlab # [ 129.743443] bundle[1985]: {"timestamp":"2026-09-14T09:30:06.551Z","pid":1985,"message":"* Environment: production"}1068vm-test-run-nixbot-gitlab> gitlab # [ 129.747652] bundle[1985]: {"timestamp":"2026-09-14T09:30:06.551Z","pid":1985,"message":"* Master PID: 1985"}1069vm-test-run-nixbot-gitlab> gitlab # [ 129.751704] bundle[1985]: {"timestamp":"2026-09-14T09:30:06.551Z","pid":1985,"message":"* Workers: 2"}1070vm-test-run-nixbot-gitlab> gitlab # [ 129.755602] bundle[1985]: {"timestamp":"2026-09-14T09:30:06.551Z","pid":1985,"message":"* Restarts: (✔) hot (✖) phased (✖) refork"}1071vm-test-run-nixbot-gitlab> gitlab # [ 129.760708] bundle[1985]: {"timestamp":"2026-09-14T09:30:06.551Z","pid":1985,"message":"* Preloading application"}1072vm-test-run-nixbot-gitlab> gitlab # [ 129.765266] sidekiq-cluster[1984]: {"severity":"INFO","time":"2026-09-14T09:30:06.519Z","message":"Starting cluster with 1 processes"}1073vm-test-run-nixbot-gitlab> gitlab # [ 139.285206] gitlab-workhorse[819]: time="2026-09-14T09:30:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1074vm-test-run-nixbot-gitlab> gitlab # [ 149.294261] gitlab-workhorse[819]: time="2026-09-14T09:30:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1075vm-test-run-nixbot-gitlab> gitlab # [ 159.305113] gitlab-workhorse[819]: time="2026-09-14T09:30:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1076vm-test-run-nixbot-gitlab> gitlab # [ 167.193743] bundle[1985]: W, [2026-09-14T09:30:44.029579 #1985] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1077vm-test-run-nixbot-gitlab> gitlab # [ 169.313337] gitlab-workhorse[819]: time="2026-09-14T09:30:46Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1078vm-test-run-nixbot-gitlab> gitlab # [ 172.264177] sidekiq-cluster[2033]: 2026-09-14T09:30:49.099Z pid=2033 tid=wnt INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>2033, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>425852928}1079vm-test-run-nixbot-gitlab> gitlab # [ 172.540313] sidekiq-cluster[2033]: W, [2026-09-14T09:30:49.377017 #2033] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1080vm-test-run-nixbot-gitlab> gitlab # [ 172.683583] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:49.520Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}1081vm-test-run-nixbot-gitlab> gitlab # [ 175.962470] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.798Z","message":"GitLab reliable fetch activated!"}1082vm-test-run-nixbot-gitlab> gitlab # [ 175.962842] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.798Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1083vm-test-run-nixbot-gitlab> gitlab # [ 176.009037] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.845Z","message":"Cron Jobs - added job with name bbo_users_delete_unconfirmed_secondary in the namespace default"}1084vm-test-run-nixbot-gitlab> gitlab # [ 176.017118] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.850Z","message":"Cron Jobs - added job with name background_operation_environments_auto_delete in the namespace default"}1085vm-test-run-nixbot-gitlab> gitlab # [ 176.024279] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.857Z","message":"Cron Jobs - added job with name adjourned_group_deletion_worker in the namespace default"}1086vm-test-run-nixbot-gitlab> gitlab # [ 176.030779] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.863Z","message":"Cron Jobs - added job with name authn_data_retention_authentication_event_archive_worker in the namespace default"}1087vm-test-run-nixbot-gitlab> gitlab # [ 176.038231] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.869Z","message":"Cron Jobs - added job with name delete_expired_trigger_token_worker in the namespace default"}1088vm-test-run-nixbot-gitlab> gitlab # [ 176.044935] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.874Z","message":"Cron Jobs - added job with name adjourned_projects_deletion_cron_worker in the namespace default"}1089vm-test-run-nixbot-gitlab> gitlab # [ 176.051740] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.878Z","message":"Cron Jobs - added job with name stuck_ci_jobs_worker in the namespace default"}1090vm-test-run-nixbot-gitlab> gitlab # [ 176.057602] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.881Z","message":"Cron Jobs - added job with name drop_timed_out_worker in the namespace default"}1091vm-test-run-nixbot-gitlab> gitlab # [ 176.063113] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.885Z","message":"Cron Jobs - added job with name pipeline_schedule_worker in the namespace default"}1092vm-test-run-nixbot-gitlab> gitlab # [ 176.068241] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.887Z","message":"Cron Jobs - added job with name ci_schedule_bulk_delete_job_artifact_cron_worker in the namespace default"}1093vm-test-run-nixbot-gitlab> gitlab # [ 176.073359] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.890Z","message":"Cron Jobs - added job with name update_locked_unknown_artifacts_worker in the namespace default"}1094vm-test-run-nixbot-gitlab> gitlab # [ 176.077838] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.895Z","message":"Cron Jobs - added job with name ci_partitioning_worker in the namespace default"}1095vm-test-run-nixbot-gitlab> gitlab # [ 176.081742] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.898Z","message":"Cron Jobs - added job with name ci_pipelines_expire_artifacts_worker in the namespace default"}1096vm-test-run-nixbot-gitlab> gitlab # [ 176.085681] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.901Z","message":"Cron Jobs - added job with name ci_schedule_delete_objects_worker in the namespace default"}1097vm-test-run-nixbot-gitlab> gitlab # [ 176.089337] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.904Z","message":"Cron Jobs - added job with name environments_auto_stop_cron_worker in the namespace default"}1098vm-test-run-nixbot-gitlab> gitlab # [ 176.092839] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.906Z","message":"Cron Jobs - added job with name repository_check_worker in the namespace default"}1099vm-test-run-nixbot-gitlab> gitlab # [ 176.095975] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.911Z","message":"Cron Jobs - added job with name admin_email_worker in the namespace default"}1100vm-test-run-nixbot-gitlab> gitlab # [ 176.099087] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.915Z","message":"Cron Jobs - added job with name personal_access_tokens_expiring_worker in the namespace default"}1101vm-test-run-nixbot-gitlab> gitlab # [ 176.102385] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.919Z","message":"Cron Jobs - added job with name deploy_tokens_expiring_worker in the namespace default"}1102vm-test-run-nixbot-gitlab> gitlab # [ 176.105392] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.923Z","message":"Cron Jobs - added job with name personal_access_tokens_expired_notification_worker in the namespace default"}1103vm-test-run-nixbot-gitlab> gitlab # [ 176.108468] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.927Z","message":"Cron Jobs - added job with name resource_access_tokens_inactive_tokens_deletion_cron_worker in the namespace default"}1104vm-test-run-nixbot-gitlab> gitlab # [ 176.111515] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.930Z","message":"Cron Jobs - added job with name repository_archive_cache_worker in the namespace default"}1105vm-test-run-nixbot-gitlab> gitlab # [ 176.114299] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.933Z","message":"Cron Jobs - added job with name import_export_project_cleanup_worker in the namespace default"}1106vm-test-run-nixbot-gitlab> gitlab # [ 176.117025] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.936Z","message":"Cron Jobs - added job with name gitlab_import_import_file_cleanup_worker in the namespace default"}1107vm-test-run-nixbot-gitlab> gitlab # [ 176.119640] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.938Z","message":"Cron Jobs - added job with name ci_archive_traces_cron_worker in the namespace default"}1108vm-test-run-nixbot-gitlab> gitlab # [ 176.122206] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.941Z","message":"Cron Jobs - added job with name members_expiring_worker in the namespace default"}1109vm-test-run-nixbot-gitlab> gitlab # [ 176.124568] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.944Z","message":"Cron Jobs - added job with name remove_expired_members_worker in the namespace default"}1110vm-test-run-nixbot-gitlab> gitlab # [ 176.126910] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.948Z","message":"Cron Jobs - added job with name remove_expired_group_links_worker in the namespace default"}1111vm-test-run-nixbot-gitlab> gitlab # [ 176.129341] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.951Z","message":"Cron Jobs - added job with name remove_unaccepted_member_invites_worker in the namespace default"}1112vm-test-run-nixbot-gitlab> gitlab # [ 176.131705] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.954Z","message":"Cron Jobs - added job with name prune_old_events_worker in the namespace default"}1113vm-test-run-nixbot-gitlab> gitlab # [ 176.134004] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.956Z","message":"Cron Jobs - added job with name gitlab_export_prune_project_export_jobs_worker in the namespace default"}1114vm-test-run-nixbot-gitlab> gitlab # [ 176.136411] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.959Z","message":"Cron Jobs - added job with name trending_projects_worker in the namespace default"}1115vm-test-run-nixbot-gitlab> gitlab # [ 176.138556] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.962Z","message":"Cron Jobs - added job with name remove_unreferenced_lfs_objects_worker in the namespace default"}1116vm-test-run-nixbot-gitlab> gitlab # [ 176.140920] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.965Z","message":"Cron Jobs - added job with name bulk_imports_stale_import_worker in the namespace default"}1117vm-test-run-nixbot-gitlab> gitlab # [ 176.143097] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.967Z","message":"Cron Jobs - added job with name import_stuck_project_import_jobs in the namespace default"}1118vm-test-run-nixbot-gitlab> gitlab # [ 176.145344] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.969Z","message":"Cron Jobs - added job with name jira_import_stuck_jira_import_jobs in the namespace default"}1119vm-test-run-nixbot-gitlab> gitlab # [ 176.147474] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.971Z","message":"Cron Jobs - added job with name stuck_export_jobs_worker in the namespace default"}1120vm-test-run-nixbot-gitlab> gitlab # [ 176.149605] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.974Z","message":"Cron Jobs - added job with name gitlab_service_ping_worker in the namespace default"}1121vm-test-run-nixbot-gitlab> gitlab # [ 176.151642] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.975Z","message":"Cron Jobs - added job with name stuck_merge_jobs_worker in the namespace default"}1122vm-test-run-nixbot-gitlab> gitlab # [ 176.153762] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.977Z","message":"Cron Jobs - added job with name pages_domain_verification_cron_worker in the namespace default"}1123vm-test-run-nixbot-gitlab> gitlab # [ 176.155908] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.980Z","message":"Cron Jobs - added job with name pages_domain_removal_cron_worker in the namespace default"}1124vm-test-run-nixbot-gitlab> gitlab # [ 176.158142] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.982Z","message":"Cron Jobs - added job with name pages_domain_ssl_renewal_cron_worker in the namespace default"}1125vm-test-run-nixbot-gitlab> gitlab # [ 176.160326] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.984Z","message":"Cron Jobs - added job with name issue_due_scheduler_worker in the namespace default"}1126vm-test-run-nixbot-gitlab> gitlab # [ 176.162373] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.986Z","message":"Cron Jobs - added job with name schedule_migrate_external_diffs_worker in the namespace default"}1127vm-test-run-nixbot-gitlab> gitlab # [ 176.164592] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.989Z","message":"Cron Jobs - added job with name namespaces_prune_aggregation_schedules_worker in the namespace default"}1128vm-test-run-nixbot-gitlab> gitlab # [ 176.166853] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.992Z","message":"Cron Jobs - added job with name container_expiration_policy_worker in the namespace default"}1129vm-test-run-nixbot-gitlab> gitlab # [ 176.169059] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.994Z","message":"Cron Jobs - added job with name cleanup_container_registry_worker in the namespace default"}1130vm-test-run-nixbot-gitlab> gitlab # [ 176.171150] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.996Z","message":"Cron Jobs - added job with name image_ttl_group_policy_worker in the namespace default"}1131vm-test-run-nixbot-gitlab> gitlab # [ 176.173473] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:52.999Z","message":"Cron Jobs - added job with name cleanup_dependency_proxy_worker in the namespace default"}1132vm-test-run-nixbot-gitlab> gitlab # [ 176.175540] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.001Z","message":"Cron Jobs - added job with name cleanup_package_registry_worker in the namespace default"}1133vm-test-run-nixbot-gitlab> gitlab # [ 176.177747] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.004Z","message":"Cron Jobs - added job with name x509_issuer_crl_check_worker in the namespace default"}1134vm-test-run-nixbot-gitlab> gitlab # [ 176.179771] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.007Z","message":"Cron Jobs - added job with name users_create_statistics_worker in the namespace default"}1135vm-test-run-nixbot-gitlab> gitlab # [ 176.188673] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.025Z","message":"Cron Jobs - added job with name authorized_project_update_periodic_recalculate_worker in the namespace default"}1136vm-test-run-nixbot-gitlab> gitlab # [ 176.193372] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.030Z","message":"Cron Jobs - added job with name update_container_registry_info_worker in the namespace default"}1137vm-test-run-nixbot-gitlab> gitlab # [ 176.196852] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.033Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_manager in the namespace default"}1138vm-test-run-nixbot-gitlab> gitlab # [ 176.200534] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.036Z","message":"Cron Jobs - added job with name postgres_dynamic_partitions_dropper in the namespace default"}1139vm-test-run-nixbot-gitlab> gitlab # [ 176.204082] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.038Z","message":"Cron Jobs - added job with name analytics_usage_trends_count_job_trigger_worker in the namespace default"}1140vm-test-run-nixbot-gitlab> gitlab # [ 176.207685] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.041Z","message":"Cron Jobs - added job with name member_invitation_reminder_emails_worker in the namespace default"}1141vm-test-run-nixbot-gitlab> gitlab # [ 176.211179] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.044Z","message":"Cron Jobs - added job with name schedule_merge_request_cleanup_refs_worker in the namespace default"}1142vm-test-run-nixbot-gitlab> gitlab # [ 176.214611] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.047Z","message":"Cron Jobs - added job with name manage_evidence_worker in the namespace default"}1143vm-test-run-nixbot-gitlab> gitlab # [ 176.217529] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.050Z","message":"Cron Jobs - added job with name publish_release_worker in the namespace default"}1144vm-test-run-nixbot-gitlab> gitlab # [ 176.221583] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.052Z","message":"Cron Jobs - added job with name user_status_cleanup_batch_worker in the namespace default"}1145vm-test-run-nixbot-gitlab> gitlab # [ 176.298193] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.133Z","message":"Cron Jobs - added job with name ssh_keys_expired_notification_worker in the namespace default"}1146vm-test-run-nixbot-gitlab> gitlab # [ 176.305197] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.138Z","message":"Cron Jobs - added job with name ssh_keys_expiring_soon_notification_worker in the namespace default"}1147vm-test-run-nixbot-gitlab> gitlab # [ 176.312081] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.141Z","message":"Cron Jobs - added job with name users_deactivate_dormant_users_worker in the namespace default"}1148vm-test-run-nixbot-gitlab> gitlab # [ 176.318804] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.144Z","message":"Cron Jobs - added job with name ci_delete_unit_tests_worker in the namespace default"}1149vm-test-run-nixbot-gitlab> gitlab # [ 176.324705] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.147Z","message":"Cron Jobs - added job with name batched_background_migrations_worker in the namespace default"}1150vm-test-run-nixbot-gitlab> gitlab # [ 176.330137] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.149Z","message":"Cron Jobs - added job with name batched_background_migration_worker_ci_database in the namespace default"}1151vm-test-run-nixbot-gitlab> gitlab # [ 176.335384] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.152Z","message":"Cron Jobs - added job with name batched_background_migration_worker_sec_database in the namespace default"}1152vm-test-run-nixbot-gitlab> gitlab # [ 176.340270] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.154Z","message":"Cron Jobs - added job with name background_operations_worker_main_database in the namespace default"}1153vm-test-run-nixbot-gitlab> gitlab # [ 176.344602] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.156Z","message":"Cron Jobs - added job with name background_operations_worker_ci_database in the namespace default"}1154vm-test-run-nixbot-gitlab> gitlab # [ 176.348624] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.158Z","message":"Cron Jobs - added job with name background_operations_worker_sec_database in the namespace default"}1155vm-test-run-nixbot-gitlab> gitlab # [ 176.352451] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.160Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_main_database in the namespace default"}1156vm-test-run-nixbot-gitlab> gitlab # [ 176.356233] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.163Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_ci_database in the namespace default"}1157vm-test-run-nixbot-gitlab> gitlab # [ 176.359802] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.165Z","message":"Cron Jobs - added job with name background_operations_worker_cell_local_sec_database in the namespace default"}1158vm-test-run-nixbot-gitlab> gitlab # [ 176.363416] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.168Z","message":"Cron Jobs - added job with name issues_reschedule_stuck_issue_rebalances in the namespace default"}1159vm-test-run-nixbot-gitlab> gitlab # [ 176.366694] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.171Z","message":"Cron Jobs - added job with name projects_schedule_refresh_build_artifacts_size_statistics_worker in the namespace default"}1160vm-test-run-nixbot-gitlab> gitlab # [ 176.370209] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.173Z","message":"Cron Jobs - added job with name inactive_projects_deletion_cron_worker in the namespace default"}1161vm-test-run-nixbot-gitlab> gitlab # [ 176.373157] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.175Z","message":"Cron Jobs - added job with name loose_foreign_keys_cleanup_worker in the namespace default"}1162vm-test-run-nixbot-gitlab> gitlab # [ 176.375873] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.177Z","message":"Cron Jobs - added job with name loose_foreign_keys_ci_pipelines_builds_cleanup_worker in the namespace default"}1163vm-test-run-nixbot-gitlab> gitlab # [ 176.378950] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.180Z","message":"Cron Jobs - added job with name loose_foreign_keys_merge_request_diff_commit_cleanup_worker in the namespace default"}1164vm-test-run-nixbot-gitlab> gitlab # [ 176.381983] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.182Z","message":"Cron Jobs - added job with name batched_git_ref_updates_cleanup_scheduler_worker in the namespace default"}1165vm-test-run-nixbot-gitlab> gitlab # [ 176.384721] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.186Z","message":"Cron Jobs - added job with name ci_runner_versions_reconciliation_worker in the namespace default"}1166vm-test-run-nixbot-gitlab> gitlab # [ 176.387224] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.187Z","message":"Cron Jobs - added job with name users_migrate_records_to_ghost_user_in_batches_worker in the namespace default"}1167vm-test-run-nixbot-gitlab> gitlab # [ 176.389976] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.190Z","message":"Cron Jobs - added job with name ci_runners_stale_machines_cleanup_worker in the namespace default"}1168vm-test-run-nixbot-gitlab> gitlab # [ 176.392450] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.193Z","message":"Cron Jobs - added job with name packages_cleanup_delete_orphaned_dependencies_worker in the namespace default"}1169vm-test-run-nixbot-gitlab> gitlab # [ 176.394963] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.196Z","message":"Cron Jobs - added job with name cleanup_dangling_debian_package_files_worker in the namespace default"}1170vm-test-run-nixbot-gitlab> gitlab # [ 176.397450] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.198Z","message":"Cron Jobs - added job with name object_storage_delete_stale_direct_uploads_worker in the namespace default"}1171vm-test-run-nixbot-gitlab> gitlab # [ 176.399845] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.200Z","message":"Cron Jobs - added job with name service_desk_custom_email_verification_cleanup in the namespace default"}1172vm-test-run-nixbot-gitlab> gitlab # [ 176.402344] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.202Z","message":"Cron Jobs - added job with name deactivated_pages_deployments_delete_cron_worker in the namespace default"}1173vm-test-run-nixbot-gitlab> gitlab # [ 176.404767] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.205Z","message":"Cron Jobs - added job with name ci_schedule_unlock_pipelines_in_queue_worker in the namespace default"}1174vm-test-run-nixbot-gitlab> gitlab # [ 176.407031] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.207Z","message":"Cron Jobs - added job with name ci_catalog_resources_process_sync_events_worker in the namespace default"}1175vm-test-run-nixbot-gitlab> gitlab # [ 176.409403] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.209Z","message":"Cron Jobs - added job with name namespaces_process_outdated_namespace_descendants_cron_worker in the namespace default"}1176vm-test-run-nixbot-gitlab> gitlab # [ 176.411695] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.211Z","message":"Cron Jobs - added job with name performance_bar_stats in the namespace default"}1177vm-test-run-nixbot-gitlab> gitlab # [ 176.413897] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.213Z","message":"Cron Jobs - added job with name ci_catalog_resources_aggregate_last30_day_usage_worker in the namespace default"}1178vm-test-run-nixbot-gitlab> gitlab # [ 176.416160] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.216Z","message":"Cron Jobs - added job with name ci_catalog_resources_cleanup_last_usages_worker in the namespace default"}1179vm-test-run-nixbot-gitlab> gitlab # [ 176.418321] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.218Z","message":"Cron Jobs - added job with name ci_click_house_finished_pipelines_sync_worker in the namespace default"}1180vm-test-run-nixbot-gitlab> gitlab # [ 176.420545] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.221Z","message":"Cron Jobs - added job with name deactivate_expired_deployments_cron_worker in the namespace default"}1181vm-test-run-nixbot-gitlab> gitlab # [ 176.422721] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.234Z","message":"Cron Jobs - added job with name database_monitor_locked_tables_cron_worker in the namespace default"}1182vm-test-run-nixbot-gitlab> gitlab # [ 176.424965] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.237Z","message":"Cron Jobs - added job with name merge_requests_process_scheduled_merge in the namespace default"}1183vm-test-run-nixbot-gitlab> gitlab # [ 176.427097] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.239Z","message":"Cron Jobs - added job with name ci_schedule_old_pipelines_removal_cron_worker in the namespace default"}1184vm-test-run-nixbot-gitlab> gitlab # [ 176.430561] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.243Z","message":"Cron Jobs - added job with name version_version_check_cron in the namespace default"}1185vm-test-run-nixbot-gitlab> gitlab # [ 176.432850] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.246Z","message":"Cron Jobs - added job with name import_placeholder_user_cleanup_worker in the namespace default"}1186vm-test-run-nixbot-gitlab> gitlab # [ 176.435212] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.249Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_grant_archive_worker in the namespace default"}1187vm-test-run-nixbot-gitlab> gitlab # [ 176.437864] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.252Z","message":"Cron Jobs - added job with name authn_data_retention_oauth_access_token_archive_worker in the namespace default"}1188vm-test-run-nixbot-gitlab> gitlab # [ 176.440411] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.254Z","message":"Cron Jobs - added job with name lost_transaction_recovery_worker in the namespace default"}1189vm-test-run-nixbot-gitlab> gitlab # [ 176.442667] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.257Z","message":"Cron Jobs - added job with name topology_service_stale_requests_cleanup_worker in the namespace default"}1190vm-test-run-nixbot-gitlab> gitlab # [ 176.445169] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.260Z","message":"Cron Jobs - added job with name cells_schedule_claims_verification_worker in the namespace default"}1191vm-test-run-nixbot-gitlab> gitlab # [ 176.447539] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:30:53.262Z","message":"Cron Jobs - added job with name concurrency_limit_resume_worker in the namespace default"}1192vm-test-run-nixbot-gitlab> gitlab # [ 179.326946] gitlab-workhorse[819]: time="2026-09-14T09:30:56Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1193vm-test-run-nixbot-gitlab> gitlab # [ 189.335295] gitlab-workhorse[819]: time="2026-09-14T09:31:06Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1194vm-test-run-nixbot-gitlab> gitlab # [ 199.336386] gitlab-workhorse[819]: time="2026-09-14T09:31:16Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1195vm-test-run-nixbot-gitlab> gitlab # [ 209.346279] gitlab-workhorse[819]: time="2026-09-14T09:31:26Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1196vm-test-run-nixbot-gitlab> gitlab # [ 214.550643] postgres[2743]: [2743] ERROR: relation "table_without_models" does not exist1197vm-test-run-nixbot-gitlab> gitlab # [ 214.551047] postgres[2743]: [2743] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1198vm-test-run-nixbot-gitlab> gitlab # [ 218.426468] postgres[2780]: [2780] ERROR: relation "table_without_models" does not exist1199vm-test-run-nixbot-gitlab> gitlab # [ 218.426823] postgres[2780]: [2780] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1200vm-test-run-nixbot-gitlab> gitlab # [ 219.354226] gitlab-workhorse[819]: time="2026-09-14T09:31:36Z" level=error correlation_id= duration_ms=0 error="badgateway: failed to receive response: dial unix /var/gitlab/state/tmp/sockets/gitlab.socket: connect: no such file or directory" method=GET uri=1201vm-test-run-nixbot-gitlab> gitlab # [ 219.500432] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:36.336Z","message":"Booted Rails 7.2.3.1 application in production environment"}1202vm-test-run-nixbot-gitlab> gitlab # [ 219.503184] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:36.339Z","message":"Running in ruby 3.3.10 (2025-10-23 revision 343ea05002) [aarch64-linux]"}1203vm-test-run-nixbot-gitlab> gitlab # [ 219.508300] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:36.339Z","message":"See LICENSE and the LGPL-3.0 for licensing details."}1204vm-test-run-nixbot-gitlab> gitlab # [ 219.510059] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:36.339Z","message":"Upgrade to Sidekiq Pro for more features and support: https://sidekiq.org"}1205vm-test-run-nixbot-gitlab> gitlab # [ 219.511964] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:36.343Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"default\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}1206vm-test-run-nixbot-gitlab> gitlab # [ 222.238237] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:39.074Z","message":"Cleaning working queues"}1207vm-test-run-nixbot-gitlab> gitlab # [ 222.242755] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:39.078Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"29a5563aedf8ab6dcdd735d0","created_at":"2026-09-14T09:30:00.578Z","trace_propagation_headers":{"sentry-trace":"e29dc4b8196f400684b6ece217bb91f3-c84138ea4d544696","baggage":"sentry-trace_id=e29dc4b8196f400684b6ece217bb91f3,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"b3b34538db2e488355fac723b455e78a","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-14T09:30:00.589Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-29a5563aedf8ab6dcdd735d0: start","job_status":"start","queue_duration_s":98.488885,"scheduling_latency_s":98.488937}1208vm-test-run-nixbot-gitlab> gitlab # [ 222.602199] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:39.438Z","retry":25,"queue":"default","version":0,"store":null,"args":[],"class":"Namespaces::ProcessSyncEventsWorker","jid":"29a5563aedf8ab6dcdd735d0","created_at":"2026-09-14T09:30:00.578Z","trace_propagation_headers":{"sentry-trace":"e29dc4b8196f400684b6ece217bb91f3-c84138ea4d544696","baggage":"sentry-trace_id=e29dc4b8196f400684b6ece217bb91f3,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"cell","correlation_id":"b3b34538db2e488355fac723b455e78a","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:99b01e5f7dc2a9b47ce31029252a21c1a7e02ef97b2a00a70d65582147f34ddb","size_limiter":"validated","enqueued_at":"2026-09-14T09:30:00.589Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessSyncEventsWorker JID-29a5563aedf8ab6dcdd735d0: done: 0.359708 sec","job_status":"done","queue_duration_s":98.488885,"scheduling_latency_s":98.488937,"redis_calls":29,"redis_duration_s":0.012615,"redis_read_bytes":282,"redis_write_bytes":3632,"redis_feature_flag_calls":18,"redis_feature_flag_duration_s":0.007562,"redis_feature_flag_read_bytes":272,"redis_feature_flag_write_bytes":2385,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.003168,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":688,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001885,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":559,"db_count":15,"db_write_count":2,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":15,"db_replica_write_count":0,"db_primary_write_count":2,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":14,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.02,"db_ci_duration_s":0.004,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.189208,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.17931058,"extra.namespaces_process_sync_events_worker.estimated_total_events":1,"extra.namespaces_process_sync_events_worker.consumable_events":1,"extra.namespaces_process_sync_events_worker.processed_events":1,"duration_s":0.359708,"completed_at":"2026-09-14T09:31:39.437Z","load_balancing_strategy":"primary","db_duration_s":0.08849,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1209vm-test-run-nixbot-gitlab> gitlab # [ 225.225573] bundle[1985]: {"timestamp":"2026-09-14T09:31:42.061Z","pid":1985,"message":"* Listening on unix:///var/gitlab/state//tmp/sockets/gitlab.socket"}1210vm-test-run-nixbot-gitlab> gitlab # [ 225.225915] bundle[1985]: {"timestamp":"2026-09-14T09:31:42.061Z","pid":1985,"message":"! WARNING: Detected 2 Thread(s) started in app boot:"}1211vm-test-run-nixbot-gitlab> gitlab # [ 225.226091] bundle[1985]: {"timestamp":"2026-09-14T09:31:42.061Z","pid":1985,"message":"! #\u003cThread:0x0000e1633fbd8f60 /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:72 sleep\u003e - /nix/store/zj7sa5zsg6vhnyq28b8v0x1jajz1gpvc-ruby3.3-rack-timeout-0.7.0/lib/ruby/gems/3.3.0/gems/rack-timeout-0.7.0/lib/rack/timeout/support/scheduler.rb:90:in `sleep'"}1212vm-test-run-nixbot-gitlab> gitlab # [ 225.226217] bundle[1985]: {"timestamp":"2026-09-14T09:31:42.061Z","pid":1985,"message":"! #\u003cThread:0x0000e1633f3593a8 /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:18 sleep\u003e - /nix/store/lnly88svq5ykjs8ynaw5cm3g88z1lvsm-ruby3.3-sentry-ruby-5.23.0/lib/ruby/gems/3.3.0/gems/sentry-ruby-5.23.0/lib/sentry/threaded_periodic_worker.rb:20:in `sleep'"}1213vm-test-run-nixbot-gitlab> gitlab # [ 225.226378] bundle[1985]: {"timestamp":"2026-09-14T09:31:42.061Z","pid":1985,"message":"Use Ctrl-C to stop"}1214vm-test-run-nixbot-gitlab> gitlab # [ 225.226493] bundle[1985]: {"timestamp":"2026-09-14T09:31:42.062Z","pid":1985,"message":"Sending status to systemd every 1.0 sec"}1215vm-test-run-nixbot-gitlab> gitlab # [ 225.937555] bundle[1985]: {"timestamp":"2026-09-14T09:31:42.774Z","pid":1985,"message":"- Worker 0 (PID: 2890) booted in 0.68s, phase: 0"}1216vm-test-run-nixbot-gitlab> gitlab # [ 225.939308] bundle[1985]: {"timestamp":"2026-09-14T09:31:42.774Z","pid":1985,"message":"- Worker 1 (PID: 2897) booted in 0.66s, phase: 0"}1217vm-test-run-nixbot-gitlab> gitlab # [ 225.946897] systemd[1]: Started gitlab.service.1218vm-test-run-nixbot-gitlab> gitlab # [ 225.947672] systemd[1]: Reached target Common target for all GitLab services..1219vm-test-run-nixbot-gitlab> gitlab # [ 225.948750] systemd[1]: Starting setup-gitlab.service...1220vm-test-run-nixbot-gitlab> gitlab # [ 225.992313] setup-gitlab-start[2927]: + timeout 900 bash -c 'until curl -fs http://gitlab/users/sign_in > /dev/null; do sleep 5; done'1221vm-test-run-nixbot-gitlab> gitlab # [ 229.622857] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:31:46 +0000] "GET /users/sign_in HTTP/1.1" 200 10655 "" "curl/8.21.0" 35881222vm-test-run-nixbot-gitlab> gitlab # [ 229.628950] setup-gitlab-start[2927]: + TOKEN=nixbot-test-token-of-20-chars1223vm-test-run-nixbot-gitlab> gitlab # [ 229.630490] setup-gitlab-start[2927]: + runuser -u gitlab -- /run/current-system/sw/bin/gitlab-rails runner $'\n ApplicationSetting.current.update!(allow_local_requests_from_web_hooks_and_services: true)\n Rails.cache.clear\n token = User.find_by_username(\'root\').personal_access_tokens.create!(\n name: \'nixbot\', scopes: [:api], expires_at: 7.days.from_now)\n token.set_token(\'nixbot-test-token-of-20-chars\')\n token.save!\n'1224vm-test-run-nixbot-gitlab> gitlab # [ 229.646066] runuser[2956]: pam_unix(runuser:session): session opened for user gitlab(uid=165) by (uid=0)1225vm-test-run-nixbot-gitlab> gitlab # [ 230.202223] setup-gitlab-start[2957]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1226vm-test-run-nixbot-gitlab> gitlab # [ 230.208892] setup-gitlab-start[2957]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1227vm-test-run-nixbot-gitlab> gitlab # [ 230.215035] setup-gitlab-start[2957]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1228vm-test-run-nixbot-gitlab> gitlab # [ 231.089359] setup-gitlab-start[2957]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=rbs version=3.4.0 platform=ruby> because it is missing extensions1229vm-test-run-nixbot-gitlab> gitlab # [ 231.089709] setup-gitlab-start[2957]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=racc version=1.7.3 platform=ruby> because it is missing extensions1230vm-test-run-nixbot-gitlab> gitlab # [ 231.092097] setup-gitlab-start[2957]: Source locally installed gems is ignoring #<Bundler::StubSpecification name=debug version=1.9.2 platform=ruby> because it is missing extensions1231vm-test-run-nixbot-gitlab> gitlab # [ 233.710220] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:50.545Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b367809ddff31d96b8aed6bb","created_at":"2026-09-14T09:31:50.444Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3dd51edcbebfce7916515346facd6422","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.542Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b367809ddff31d96b8aed6bb: start","job_status":"start","queue_duration_s":0.002811,"scheduling_latency_s":0.002853}1232vm-test-run-nixbot-gitlab> gitlab # [ 233.909669] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:50.745Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"b367809ddff31d96b8aed6bb","created_at":"2026-09-14T09:31:50.444Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3dd51edcbebfce7916515346facd6422","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.542Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-b367809ddff31d96b8aed6bb: done: 0.199804 sec","job_status":"done","queue_duration_s":0.002811,"scheduling_latency_s":0.002853,"redis_calls":12,"redis_duration_s":0.020757,"redis_read_bytes":11,"redis_write_bytes":1511,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.001705,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":331,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.013764,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":614,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005288,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":566,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.017,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.046837,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00215298,"exclusive_lock_hold_duration_s":0.020428119999999998,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.199804,"completed_at":"2026-09-14T09:31:50.745Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.065972,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1233vm-test-run-nixbot-gitlab> gitlab # [ 234.007755] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:50.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"55192791bf09b2b09e6aa42a","created_at":"2026-09-14T09:31:50.615Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9eb7c4047582cb428e23643919560110","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.628Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-55192791bf09b2b09e6aa42a: start","job_status":"start","queue_duration_s":0.125695,"scheduling_latency_s":0.12575}1234vm-test-run-nixbot-gitlab> gitlab # [ 234.030844] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:50.798Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1235vm-test-run-nixbot-gitlab> gitlab # [ 234.035441] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:50.825Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"55192791bf09b2b09e6aa42a","created_at":"2026-09-14T09:31:50.615Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9eb7c4047582cb428e23643919560110","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.628Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-55192791bf09b2b09e6aa42a: done: 0.071795 sec","job_status":"done","queue_duration_s":0.125695,"scheduling_latency_s":0.12575,"redis_calls":10,"redis_duration_s":0.0070220000000000005,"redis_read_bytes":9,"redis_write_bytes":1207,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000977,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003409,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03081,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007237,"duration_s":0.071795,"completed_at":"2026-09-14T09:31:50.825Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001027,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1236vm-test-run-nixbot-gitlab> gitlab # [ 234.082410] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:50.856Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b29bf0e26c27a44fd8c196f9","created_at":"2026-09-14T09:31:50.671Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7dcc2efe7a980dc433f3422b05df46e0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.683Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b29bf0e26c27a44fd8c196f9: start","job_status":"start","queue_duration_s":0.17332,"scheduling_latency_s":0.17337}1237vm-test-run-nixbot-gitlab> gitlab # [ 234.494920] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:51.330Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"b29bf0e26c27a44fd8c196f9","created_at":"2026-09-14T09:31:50.671Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7dcc2efe7a980dc433f3422b05df46e0","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.683Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-b29bf0e26c27a44fd8c196f9: done: 0.473685 sec","job_status":"done","queue_duration_s":0.17332,"scheduling_latency_s":0.17337,"redis_calls":12,"redis_duration_s":0.023652,"redis_read_bytes":11,"redis_write_bytes":1622,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002441,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":349,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.015238,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":658,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.005973,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":615,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.104,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.104,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.147123,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0027843,"exclusive_lock_hold_duration_s":0.28504656,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.473685,"completed_at":"2026-09-14T09:31:51.329Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.119063,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1238vm-test-run-nixbot-gitlab> gitlab # [ 234.591678] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:51.335Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0dd6d3838504c6ffda25597b","created_at":"2026-09-14T09:31:50.714Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19cd1b61379d5dcaa10b723ef733a0e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T09:31:50.741Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0dd6d3838504c6ffda25597b: start","job_status":"start","queue_duration_s":0.593209,"scheduling_latency_s":0.593272}1239vm-test-run-nixbot-gitlab> gitlab # [ 234.609959] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:51.382Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1240vm-test-run-nixbot-gitlab> gitlab # [ 234.614299] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:51.413Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"0dd6d3838504c6ffda25597b","created_at":"2026-09-14T09:31:50.714Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"19cd1b61379d5dcaa10b723ef733a0e8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T09:31:50.741Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-0dd6d3838504c6ffda25597b: done: 0.078057 sec","job_status":"done","queue_duration_s":0.593209,"scheduling_latency_s":0.593272,"redis_calls":10,"redis_duration_s":0.005159,"redis_read_bytes":9,"redis_write_bytes":1261,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002175,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":353,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002177,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":650,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000807,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":258,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032454,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00068344,"duration_s":0.078057,"completed_at":"2026-09-14T09:31:51.413Z","load_balancing_strategy":"primary","db_duration_s":0.007216,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1241vm-test-run-nixbot-gitlab> gitlab # [ 234.665471] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:51.418Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"02f6d0b91c9e6e830ea2de1d","created_at":"2026-09-14T09:31:50.760Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"69865d7e10981a2d2c9f06ee949d490c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T09:31:50.819Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-02f6d0b91c9e6e830ea2de1d: start","job_status":"start","queue_duration_s":0.598647,"scheduling_latency_s":0.599218}1242vm-test-run-nixbot-gitlab> gitlab # [ 234.764294] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:51.598Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"02f6d0b91c9e6e830ea2de1d","created_at":"2026-09-14T09:31:50.760Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"69865d7e10981a2d2c9f06ee949d490c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T09:31:50.819Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-02f6d0b91c9e6e830ea2de1d: done: 0.18102 sec","job_status":"done","queue_duration_s":0.598647,"scheduling_latency_s":0.599218,"redis_calls":10,"redis_duration_s":0.011928,"redis_read_bytes":9,"redis_write_bytes":1157,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.002756,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.006741,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":598,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002431,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":232,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.061821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00325476,"duration_s":0.18102,"completed_at":"2026-09-14T09:31:51.598Z","load_balancing_strategy":"primary","db_duration_s":0.036322,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1243vm-test-run-nixbot-gitlab> gitlab # [ 234.829617] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:51.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a103fbff80266de6df1d69b3","created_at":"2026-09-14T09:31:50.854Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddf48ecd3374601f5af638f76c507cb9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.872Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a103fbff80266de6df1d69b3: start","job_status":"start","queue_duration_s":0.7314,"scheduling_latency_s":0.731456}1244vm-test-run-nixbot-gitlab> gitlab # [ 234.882305] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:51.718Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"a103fbff80266de6df1d69b3","created_at":"2026-09-14T09:31:50.854Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"ddf48ecd3374601f5af638f76c507cb9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.872Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-a103fbff80266de6df1d69b3: done: 0.114414 sec","job_status":"done","queue_duration_s":0.7314,"scheduling_latency_s":0.731456,"redis_calls":12,"redis_duration_s":0.004593,"redis_read_bytes":11,"redis_write_bytes":1566,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.001666,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":628,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002084,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":670,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000843,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":268,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.037711,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00056824,"duration_s":0.114414,"completed_at":"2026-09-14T09:31:51.718Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00152,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1245vm-test-run-nixbot-gitlab> gitlab # [ 234.949757] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:51.720Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"ca0d8f841ab4b01cbc072017","created_at":"2026-09-14T09:31:50.906Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"372ee3149be92bef86b5739d96aa054c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.938Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-ca0d8f841ab4b01cbc072017: start","job_status":"start","queue_duration_s":0.782636,"scheduling_latency_s":0.782669}1246vm-test-run-nixbot-gitlab> gitlab # [ 234.965350] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:51.750Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"ca0d8f841ab4b01cbc072017","created_at":"2026-09-14T09:31:50.906Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"372ee3149be92bef86b5739d96aa054c","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.938Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-ca0d8f841ab4b01cbc072017: done: 0.029688 sec","job_status":"done","queue_duration_s":0.782636,"scheduling_latency_s":0.782669,"redis_calls":10,"redis_duration_s":0.002087,"redis_read_bytes":9,"redis_write_bytes":1215,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000462,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":343,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001178,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":626,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000447,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":246,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032582,"duration_s":0.029688,"completed_at":"2026-09-14T09:31:51.750Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000477,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1247vm-test-run-nixbot-gitlab> gitlab # [ 235.008377] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:51.752Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"df0a6afdfb3ecb6fe183d4b2","created_at":"2026-09-14T09:31:50.949Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90832db92fdc73cc11b873070ed00781","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.963Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-df0a6afdfb3ecb6fe183d4b2: start","job_status":"start","queue_duration_s":0.789098,"scheduling_latency_s":0.789124}1248vm-test-run-nixbot-gitlab> gitlab # [ 235.021475] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:51.795Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"df0a6afdfb3ecb6fe183d4b2","created_at":"2026-09-14T09:31:50.949Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"90832db92fdc73cc11b873070ed00781","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.963Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-df0a6afdfb3ecb6fe183d4b2: done: 0.043063 sec","job_status":"done","queue_duration_s":0.789098,"scheduling_latency_s":0.789124,"redis_calls":19,"redis_duration_s":0.0032719999999999997,"redis_read_bytes":22,"redis_write_bytes":4789,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.000812,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":672,"redis_queues_calls":2,"redis_queues_duration_s":0.000287,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":10,"redis_queues_metadata_duration_s":0.001571,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":814,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000602,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":284,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031989,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0002485,"duration_s":0.043063,"completed_at":"2026-09-14T09:31:51.795Z","load_balancing_strategy":"primary","db_duration_s":0.002119,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1249vm-test-run-nixbot-gitlab> gitlab # [ 235.063494] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:51.796Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"aaeca06ec814ca39eaf60e02","created_at":"2026-09-14T09:31:50.975Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b28541680c2789c19d705c2a12d2ea5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.985Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-aaeca06ec814ca39eaf60e02: start","job_status":"start","queue_duration_s":0.811591,"scheduling_latency_s":0.811614}1250vm-test-run-nixbot-gitlab> gitlab # [ 235.297513] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.133Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"aaeca06ec814ca39eaf60e02","created_at":"2026-09-14T09:31:50.975Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9b28541680c2789c19d705c2a12d2ea5","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:50.985Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-aaeca06ec814ca39eaf60e02: done: 0.336945 sec","job_status":"done","queue_duration_s":0.811591,"scheduling_latency_s":0.811614,"redis_calls":14,"redis_duration_s":0.002823,"redis_read_bytes":13,"redis_write_bytes":1641,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.00063,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":576,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001183,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00101,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":511,"db_count":131,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":131,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.061,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.061,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.259933,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00052822,"exclusive_lock_hold_duration_s":0.31191796,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.336945,"completed_at":"2026-09-14T09:31:52.133Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.088805,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1251vm-test-run-nixbot-gitlab> gitlab # [ 235.390323] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.135Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f9cdec6b9aa70eeb72456890","created_at":"2026-09-14T09:31:51.064Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ae6e6831a268f6fbf9ac7bc5f990818","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.082Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f9cdec6b9aa70eeb72456890: start","job_status":"start","queue_duration_s":1.053073,"scheduling_latency_s":1.053095}1252vm-test-run-nixbot-gitlab> gitlab # [ 235.615629] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.452Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"f9cdec6b9aa70eeb72456890","created_at":"2026-09-14T09:31:51.064Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"6ae6e6831a268f6fbf9ac7bc5f990818","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.082Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-f9cdec6b9aa70eeb72456890: done: 0.316476 sec","job_status":"done","queue_duration_s":1.053073,"scheduling_latency_s":1.053095,"redis_calls":565,"redis_duration_s":0.068435,"redis_read_bytes":564,"redis_write_bytes":49139,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000508,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001171,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":546,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.066756,"redis_shared_state_read_bytes":558,"redis_shared_state_write_bytes":48290,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.280325,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00045284,"duration_s":0.316476,"completed_at":"2026-09-14T09:31:52.452Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000556,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1253vm-test-run-nixbot-gitlab> gitlab # [ 235.711462] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.453Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ebd85e773f1b019a2df82d63","created_at":"2026-09-14T09:31:51.091Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1a1eeddd2d29e53a1b47e530421e4de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.106Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ebd85e773f1b019a2df82d63: start","job_status":"start","queue_duration_s":1.347249,"scheduling_latency_s":1.347271}1254vm-test-run-nixbot-gitlab> gitlab # [ 235.730034] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.465Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1255vm-test-run-nixbot-gitlab> gitlab # [ 235.734184] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.473Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"ebd85e773f1b019a2df82d63","created_at":"2026-09-14T09:31:51.091Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c1a1eeddd2d29e53a1b47e530421e4de","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.106Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-ebd85e773f1b019a2df82d63: done: 0.01957 sec","job_status":"done","queue_duration_s":1.347249,"scheduling_latency_s":1.347271,"redis_calls":10,"redis_duration_s":0.001695,"redis_read_bytes":9,"redis_write_bytes":1199,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000362,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":339,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000976,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":618,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000357,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":242,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011603,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00027066,"duration_s":0.01957,"completed_at":"2026-09-14T09:31:52.473Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000502,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1256vm-test-run-nixbot-gitlab> gitlab # [ 235.777718] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.474Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3c825396146c98d4ef6cd8dc","created_at":"2026-09-14T09:31:51.124Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c8ebc30551cdc4d3a543f787a97dc8a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T09:31:51.136Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3c825396146c98d4ef6cd8dc: start","job_status":"start","queue_duration_s":1.337852,"scheduling_latency_s":1.337871}1257vm-test-run-nixbot-gitlab> gitlab # [ 235.791082] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.486Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1258vm-test-run-nixbot-gitlab> gitlab # [ 235.794867] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.493Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"3c825396146c98d4ef6cd8dc","created_at":"2026-09-14T09:31:51.124Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"5c8ebc30551cdc4d3a543f787a97dc8a","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T09:31:51.136Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-3c825396146c98d4ef6cd8dc: done: 0.018721 sec","job_status":"done","queue_duration_s":1.337852,"scheduling_latency_s":1.337871,"redis_calls":10,"redis_duration_s":0.0019160000000000002,"redis_read_bytes":9,"redis_write_bytes":1253,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000399,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":351,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001126,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":646,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000391,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":256,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010722,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00028364,"duration_s":0.018721,"completed_at":"2026-09-14T09:31:52.493Z","load_balancing_strategy":"primary","db_duration_s":0.000356,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1259vm-test-run-nixbot-gitlab> gitlab # [ 235.837143] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.494Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"9c65d1db88758702297f1bcd","created_at":"2026-09-14T09:31:51.146Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ad5270594b35cad6c06a60f7441fff1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-9c65d1db88758702297f1bcd: start","job_status":"start","queue_duration_s":1.337258,"scheduling_latency_s":1.337443}1260vm-test-run-nixbot-gitlab> gitlab # [ 235.851513] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.506Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1261vm-test-run-nixbot-gitlab> gitlab # [ 235.855347] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.513Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"9c65d1db88758702297f1bcd","created_at":"2026-09-14T09:31:51.146Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2ad5270594b35cad6c06a60f7441fff1","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-9c65d1db88758702297f1bcd: done: 0.019234 sec","job_status":"done","queue_duration_s":1.337258,"scheduling_latency_s":1.337443,"redis_calls":10,"redis_duration_s":0.002312,"redis_read_bytes":9,"redis_write_bytes":1283,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000467,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001354,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":662,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":264,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010743,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003429,"duration_s":0.019234,"completed_at":"2026-09-14T09:31:52.513Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000322,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1262vm-test-run-nixbot-gitlab> gitlab # [ 235.897574] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.515Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c107999da871dd7c981d270a","created_at":"2026-09-14T09:31:51.167Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"081660154bae367b482b7b964fac2dfe","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.184Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c107999da871dd7c981d270a: start","job_status":"start","queue_duration_s":1.331269,"scheduling_latency_s":1.331293}1263vm-test-run-nixbot-gitlab> gitlab # [ 235.911322] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.567Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"c107999da871dd7c981d270a","created_at":"2026-09-14T09:31:51.167Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"081660154bae367b482b7b964fac2dfe","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.184Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-c107999da871dd7c981d270a: done: 0.051715 sec","job_status":"done","queue_duration_s":1.331269,"scheduling_latency_s":1.331293,"redis_calls":10,"redis_duration_s":0.002801,"redis_read_bytes":9,"redis_write_bytes":1289,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000488,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":357,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001749,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000564,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.024,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.024,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01584,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00078742,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.051715,"completed_at":"2026-09-14T09:31:52.567Z","load_balancing_strategy":"primary","db_duration_s":0.02728,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1264vm-test-run-nixbot-gitlab> gitlab # [ 235.953606] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.569Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"bc4abefdc6979b8176159f33","created_at":"2026-09-14T09:31:51.225Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.237Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-bc4abefdc6979b8176159f33: start","job_status":"start","queue_duration_s":1.331308,"scheduling_latency_s":1.331333}1265vm-test-run-nixbot-gitlab> gitlab # [ 235.967032] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.695Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"bc4abefdc6979b8176159f33","created_at":"2026-09-14T09:31:51.225Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.237Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-bc4abefdc6979b8176159f33: done: 0.126318 sec","job_status":"done","queue_duration_s":1.331308,"scheduling_latency_s":1.331333,"redis_calls":71,"redis_duration_s":0.022267000000000002,"redis_read_bytes":120,"redis_write_bytes":42674,"redis_feature_flag_calls":10,"redis_feature_flag_duration_s":0.008,"redis_feature_flag_read_bytes":10,"redis_feature_flag_write_bytes":1471,"redis_queues_calls":2,"redis_queues_duration_s":0.000729,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.012684,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3418,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000854,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":300,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.098604,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00024946,"duration_s":0.126318,"completed_at":"2026-09-14T09:31:52.695Z","load_balancing_strategy":"primary","db_duration_s":0.006515,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1266vm-test-run-nixbot-gitlab> gitlab # [ 236.009687] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.696Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"39c4400c8ef87454be87605b","created_at":"2026-09-14T09:31:51.263Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37aba13753763c05d2ca31dd7c954f63","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.279Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-39c4400c8ef87454be87605b: start","job_status":"start","queue_duration_s":1.41722,"scheduling_latency_s":1.417243}1267vm-test-run-nixbot-gitlab> gitlab # [ 236.024184] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.726Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"39c4400c8ef87454be87605b","created_at":"2026-09-14T09:31:51.263Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"37aba13753763c05d2ca31dd7c954f63","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.279Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-39c4400c8ef87454be87605b: done: 0.029106 sec","job_status":"done","queue_duration_s":1.41722,"scheduling_latency_s":1.417243,"redis_calls":12,"redis_duration_s":0.0019560000000000003,"redis_read_bytes":11,"redis_write_bytes":1489,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":327,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":602,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000714,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":560,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016411,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00051584,"exclusive_lock_hold_duration_s":0.009715759999999999,"duration_s":0.029106,"completed_at":"2026-09-14T09:31:52.725Z","load_balancing_strategy":"primary","db_duration_s":0.005927,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1268vm-test-run-nixbot-gitlab> gitlab # [ 236.065596] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.727Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"dd92885955a83c327daf3217","created_at":"2026-09-14T09:31:51.323Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc0dcdc19207d2557acc058feccc7337","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.341Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-dd92885955a83c327daf3217: start","job_status":"start","queue_duration_s":1.385681,"scheduling_latency_s":1.385703}1269vm-test-run-nixbot-gitlab> gitlab # [ 236.079953] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.760Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"dd92885955a83c327daf3217","created_at":"2026-09-14T09:31:51.323Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dc0dcdc19207d2557acc058feccc7337","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.341Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-dd92885955a83c327daf3217: done: 0.033028 sec","job_status":"done","queue_duration_s":1.385681,"scheduling_latency_s":1.385703,"redis_calls":13,"redis_duration_s":0.001889,"redis_read_bytes":12,"redis_write_bytes":1668,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00029,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":7,"redis_queues_metadata_duration_s":0.000928,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":728,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000671,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":603,"db_count":4,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.021378,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.01062396,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.033028,"completed_at":"2026-09-14T09:31:52.760Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004046,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1270vm-test-run-nixbot-gitlab> gitlab # [ 236.123782] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.761Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d1c02754a577410719df7f7b","created_at":"2026-09-14T09:31:51.371Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c76e8e1adb90a21c2a9afc526c6af78","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.408Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d1c02754a577410719df7f7b: start","job_status":"start","queue_duration_s":1.353723,"scheduling_latency_s":1.353744}1271vm-test-run-nixbot-gitlab> gitlab # [ 236.138429] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.826Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"d1c02754a577410719df7f7b","created_at":"2026-09-14T09:31:51.371Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1c76e8e1adb90a21c2a9afc526c6af78","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.408Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-d1c02754a577410719df7f7b: done: 0.064498 sec","job_status":"done","queue_duration_s":1.353723,"scheduling_latency_s":1.353744,"redis_calls":12,"redis_duration_s":0.002418,"redis_read_bytes":11,"redis_write_bytes":1612,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000282,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":347,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001184,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":654,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":611,"db_count":7,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":7,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.009,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.009,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040451,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00050256,"exclusive_lock_hold_duration_s":0.03412452,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.064498,"completed_at":"2026-09-14T09:31:52.826Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.012484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1272vm-test-run-nixbot-gitlab> gitlab # [ 236.182584] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.829Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e4f9196a0d78d2e4d7986620","created_at":"2026-09-14T09:31:51.453Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7cd22725265024f69e4a33a31a1178a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.464Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e4f9196a0d78d2e4d7986620: start","job_status":"start","queue_duration_s":1.365228,"scheduling_latency_s":1.36527}1273vm-test-run-nixbot-gitlab> gitlab # [ 236.196586] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.887Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"e4f9196a0d78d2e4d7986620","created_at":"2026-09-14T09:31:51.453Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c7cd22725265024f69e4a33a31a1178a","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.464Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-e4f9196a0d78d2e4d7986620: done: 0.058039 sec","job_status":"done","queue_duration_s":1.365228,"scheduling_latency_s":1.36527,"redis_calls":10,"redis_duration_s":0.0046300000000000004,"redis_read_bytes":9,"redis_write_bytes":1061,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00074,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":303,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003019,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":550,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000871,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":208,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00085156,"duration_s":0.058039,"completed_at":"2026-09-14T09:31:52.887Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005443,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1274vm-test-run-nixbot-gitlab> gitlab # [ 236.239087] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:52.896Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"98fad4e26ea5e7790b857988","created_at":"2026-09-14T09:31:51.502Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1195ca3f090ef4a6828bd117c7f7a59c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.540Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-98fad4e26ea5e7790b857988: start","job_status":"start","queue_duration_s":1.355304,"scheduling_latency_s":1.35535}1275vm-test-run-nixbot-gitlab> gitlab # [ 236.253230] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.082Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"98fad4e26ea5e7790b857988","created_at":"2026-09-14T09:31:51.502Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1195ca3f090ef4a6828bd117c7f7a59c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.540Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-98fad4e26ea5e7790b857988: done: 0.186536 sec","job_status":"done","queue_duration_s":1.355304,"scheduling_latency_s":1.35535,"redis_calls":16,"redis_duration_s":0.005576,"redis_read_bytes":15,"redis_write_bytes":1942,"redis_feature_flag_calls":8,"redis_feature_flag_duration_s":0.002876,"redis_feature_flag_read_bytes":8,"redis_feature_flag_write_bytes":1148,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00194,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":574,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00076,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":220,"db_count":6,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.01,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":6,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.01,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.160201,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003535,"duration_s":0.186536,"completed_at":"2026-09-14T09:31:53.082Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.009897,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1276vm-test-run-nixbot-gitlab> gitlab # [ 236.294806] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.084Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"32308dc2aa72b3dd8af2e07e","created_at":"2026-09-14T09:31:51.560Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8b2305ea77a67d125dbd2704e3dcb08","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.591Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-32308dc2aa72b3dd8af2e07e: start","job_status":"start","queue_duration_s":1.49294,"scheduling_latency_s":1.492957}1277vm-test-run-nixbot-gitlab> gitlab # [ 236.309223] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.095Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1278vm-test-run-nixbot-gitlab> gitlab # [ 236.312512] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.103Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"32308dc2aa72b3dd8af2e07e","created_at":"2026-09-14T09:31:51.560Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8b2305ea77a67d125dbd2704e3dcb08","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.591Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-32308dc2aa72b3dd8af2e07e: done: 0.019312 sec","job_status":"done","queue_duration_s":1.49294,"scheduling_latency_s":1.492957,"redis_calls":10,"redis_duration_s":0.00228,"redis_read_bytes":9,"redis_write_bytes":1291,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000452,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":359,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001326,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":666,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000502,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010112,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003279,"duration_s":0.019312,"completed_at":"2026-09-14T09:31:53.103Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000375,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1279vm-test-run-nixbot-gitlab> gitlab # [ 236.354631] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.105Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"efddea028d25b8ed377ae052","created_at":"2026-09-14T09:31:51.772Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-125b146bed764037","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90832db92fdc73cc11b873070ed00781","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.787Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-efddea028d25b8ed377ae052: start","job_status":"start","queue_duration_s":1.317821,"scheduling_latency_s":1.317839}1280vm-test-run-nixbot-gitlab> gitlab # [ 236.366923] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.121Z","message":"No existing merge request to be cleaned up."}1281vm-test-run-nixbot-gitlab> gitlab # [ 236.368607] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.135Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"efddea028d25b8ed377ae052","created_at":"2026-09-14T09:31:51.772Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-125b146bed764037","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90832db92fdc73cc11b873070ed00781","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.787Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-efddea028d25b8ed377ae052: done: 0.030262 sec","job_status":"done","queue_duration_s":1.317821,"scheduling_latency_s":1.317839,"redis_calls":13,"redis_duration_s":0.003476,"redis_read_bytes":12,"redis_write_bytes":1401,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000464,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001187,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":431,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001825,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":669,"db_count":4,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":4,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":4,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01926,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032138,"duration_s":0.030262,"completed_at":"2026-09-14T09:31:53.135Z","load_balancing_strategy":"primary","db_duration_s":0.003673,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1282vm-test-run-nixbot-gitlab> gitlab # [ 236.408202] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.137Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d3d4b2371e7ff1692073669c","created_at":"2026-09-14T09:31:51.772Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-125b146bed764037","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90832db92fdc73cc11b873070ed00781","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.787Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d3d4b2371e7ff1692073669c: start","job_status":"start","queue_duration_s":1.349648,"scheduling_latency_s":1.349664}1283vm-test-run-nixbot-gitlab> gitlab # [ 236.420271] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.148Z","message":"No existing merge request to be cleaned up."}1284vm-test-run-nixbot-gitlab> gitlab # [ 236.421908] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.156Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"d3d4b2371e7ff1692073669c","created_at":"2026-09-14T09:31:51.772Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-125b146bed764037","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90832db92fdc73cc11b873070ed00781","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.787Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-d3d4b2371e7ff1692073669c: done: 0.019307 sec","job_status":"done","queue_duration_s":1.349648,"scheduling_latency_s":1.349664,"redis_calls":10,"redis_duration_s":0.002383,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000966,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001417,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013117,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019307,"completed_at":"2026-09-14T09:31:53.156Z","load_balancing_strategy":"primary","db_duration_s":0.001425,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1285vm-test-run-nixbot-gitlab> gitlab # [ 236.461102] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.158Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cc9f171840e215963bc523c8","created_at":"2026-09-14T09:31:51.772Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-125b146bed764037","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90832db92fdc73cc11b873070ed00781","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.787Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cc9f171840e215963bc523c8: start","job_status":"start","queue_duration_s":1.37052,"scheduling_latency_s":1.370537}1286vm-test-run-nixbot-gitlab> gitlab # [ 236.473248] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.169Z","message":"No existing merge request to be cleaned up."}1287vm-test-run-nixbot-gitlab> gitlab # [ 236.474907] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.178Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"cc9f171840e215963bc523c8","created_at":"2026-09-14T09:31:51.772Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-125b146bed764037","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90832db92fdc73cc11b873070ed00781","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.787Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-cc9f171840e215963bc523c8: done: 0.020574 sec","job_status":"done","queue_duration_s":1.37052,"scheduling_latency_s":1.370537,"redis_calls":10,"redis_duration_s":0.003083,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000992,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.002091,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013733,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020574,"completed_at":"2026-09-14T09:31:53.178Z","load_balancing_strategy":"primary","db_duration_s":0.00153,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1288vm-test-run-nixbot-gitlab> gitlab # [ 236.512944] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.180Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1cff19488ffd515042fc1d8f","created_at":"2026-09-14T09:31:51.772Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-125b146bed764037","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90832db92fdc73cc11b873070ed00781","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.787Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1cff19488ffd515042fc1d8f: start","job_status":"start","queue_duration_s":1.393338,"scheduling_latency_s":1.393356}1289vm-test-run-nixbot-gitlab> gitlab # [ 236.525121] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.190Z","message":"No existing merge request to be cleaned up."}1290vm-test-run-nixbot-gitlab> gitlab # [ 236.526759] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.199Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"1cff19488ffd515042fc1d8f","created_at":"2026-09-14T09:31:51.772Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-125b146bed764037","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"90832db92fdc73cc11b873070ed00781","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:51.787Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-1cff19488ffd515042fc1d8f: done: 0.018709 sec","job_status":"done","queue_duration_s":1.393338,"scheduling_latency_s":1.393356,"redis_calls":10,"redis_duration_s":0.002303,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001369,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012968,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018709,"completed_at":"2026-09-14T09:31:53.199Z","load_balancing_strategy":"primary","db_duration_s":0.001232,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1291vm-test-run-nixbot-gitlab> gitlab # [ 236.564993] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.200Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e51cc401f7d8901cc2175b7","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e51cc401f7d8901cc2175b7: start","job_status":"start","queue_duration_s":0.514322,"scheduling_latency_s":0.514338}1292vm-test-run-nixbot-gitlab> gitlab # [ 236.577204] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.223Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2e51cc401f7d8901cc2175b7","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2e51cc401f7d8901cc2175b7: done: 0.022434 sec","job_status":"done","queue_duration_s":0.514322,"scheduling_latency_s":0.514338,"redis_calls":16,"redis_duration_s":0.0034729999999999995,"redis_read_bytes":14,"redis_write_bytes":1544,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000451,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":307,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000991,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":439,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002031,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":798,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013088,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00031444,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.022434,"completed_at":"2026-09-14T09:31:53.223Z","load_balancing_strategy":"primary","db_duration_s":0.000385,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1293vm-test-run-nixbot-gitlab> gitlab # [ 236.618054] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.224Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e94c95b4c2098c57e9859336","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e94c95b4c2098c57e9859336: start","job_status":"start","queue_duration_s":0.538039,"scheduling_latency_s":0.538056}1294vm-test-run-nixbot-gitlab> gitlab # [ 236.630468] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.239Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e94c95b4c2098c57e9859336","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e94c95b4c2098c57e9859336: done: 0.015096 sec","job_status":"done","queue_duration_s":0.538039,"scheduling_latency_s":0.538056,"redis_calls":13,"redis_duration_s":0.002523,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000912,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001611,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009803,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015096,"completed_at":"2026-09-14T09:31:53.239Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1295vm-test-run-nixbot-gitlab> gitlab # [ 236.670223] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3ffa8385c71e8c29f762ae6","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3ffa8385c71e8c29f762ae6: start","job_status":"start","queue_duration_s":0.554397,"scheduling_latency_s":0.554414}1296vm-test-run-nixbot-gitlab> gitlab # [ 236.682581] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.257Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f3ffa8385c71e8c29f762ae6","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f3ffa8385c71e8c29f762ae6: done: 0.01678 sec","job_status":"done","queue_duration_s":0.554397,"scheduling_latency_s":0.554414,"redis_calls":13,"redis_duration_s":0.003813,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01678,"completed_at":"2026-09-14T09:31:53.257Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1297vm-test-run-nixbot-gitlab> gitlab # [ 236.721372] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.259Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d21f3cbe0234e5da8c32f8c7","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d21f3cbe0234e5da8c32f8c7: start","job_status":"start","queue_duration_s":0.572519,"scheduling_latency_s":0.572541}1298vm-test-run-nixbot-gitlab> gitlab # [ 236.733568] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.275Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d21f3cbe0234e5da8c32f8c7","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d21f3cbe0234e5da8c32f8c7: done: 0.01645 sec","job_status":"done","queue_duration_s":0.572519,"scheduling_latency_s":0.572541,"redis_calls":13,"redis_duration_s":0.002627,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000946,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001681,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009161,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01645,"completed_at":"2026-09-14T09:31:53.275Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1299vm-test-run-nixbot-gitlab> gitlab # [ 236.772404] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.276Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fedcb2921d6bfe8641074f8a","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fedcb2921d6bfe8641074f8a: start","job_status":"start","queue_duration_s":0.590333,"scheduling_latency_s":0.590348}1300vm-test-run-nixbot-gitlab> gitlab # [ 236.784967] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.292Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fedcb2921d6bfe8641074f8a","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fedcb2921d6bfe8641074f8a: done: 0.015228 sec","job_status":"done","queue_duration_s":0.590333,"scheduling_latency_s":0.590348,"redis_calls":13,"redis_duration_s":0.002767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001869,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009769,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015228,"completed_at":"2026-09-14T09:31:53.292Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1301vm-test-run-nixbot-gitlab> gitlab # [ 236.823685] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.293Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82974542ed6688a8a190a201","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82974542ed6688a8a190a201: start","job_status":"start","queue_duration_s":0.606953,"scheduling_latency_s":0.606969}1302vm-test-run-nixbot-gitlab> gitlab # [ 236.836211] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.308Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"82974542ed6688a8a190a201","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-82974542ed6688a8a190a201: done: 0.015117 sec","job_status":"done","queue_duration_s":0.606953,"scheduling_latency_s":0.606969,"redis_calls":13,"redis_duration_s":0.002676,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000943,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001733,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00975,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015117,"completed_at":"2026-09-14T09:31:53.308Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1303vm-test-run-nixbot-gitlab> gitlab # [ 236.875944] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34393adf97f12ed12a93aeb3","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34393adf97f12ed12a93aeb3: start","job_status":"start","queue_duration_s":0.623451,"scheduling_latency_s":0.623468}1304vm-test-run-nixbot-gitlab> gitlab # [ 236.888403] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"34393adf97f12ed12a93aeb3","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-34393adf97f12ed12a93aeb3: done: 0.01658 sec","job_status":"done","queue_duration_s":0.623451,"scheduling_latency_s":0.623468,"redis_calls":13,"redis_duration_s":0.0027199999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001785,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010103,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01658,"completed_at":"2026-09-14T09:31:53.326Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1305vm-test-run-nixbot-gitlab> gitlab # [ 236.927727] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.328Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0ac9f05659c5bf3bc873e18","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0ac9f05659c5bf3bc873e18: start","job_status":"start","queue_duration_s":0.641409,"scheduling_latency_s":0.641425}1306vm-test-run-nixbot-gitlab> gitlab # [ 236.940310] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.344Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c0ac9f05659c5bf3bc873e18","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c0ac9f05659c5bf3bc873e18: done: 0.016089 sec","job_status":"done","queue_duration_s":0.641409,"scheduling_latency_s":0.641425,"redis_calls":13,"redis_duration_s":0.003439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000968,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002471,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010068,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016089,"completed_at":"2026-09-14T09:31:53.344Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1307vm-test-run-nixbot-gitlab> gitlab # [ 236.979388] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.345Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8090a9d7e82058d97c5c486","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8090a9d7e82058d97c5c486: start","job_status":"start","queue_duration_s":0.658904,"scheduling_latency_s":0.658921}1308vm-test-run-nixbot-gitlab> gitlab # [ 236.992189] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.360Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a8090a9d7e82058d97c5c486","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a8090a9d7e82058d97c5c486: done: 0.014965 sec","job_status":"done","queue_duration_s":0.658904,"scheduling_latency_s":0.658921,"redis_calls":13,"redis_duration_s":0.00261,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001712,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009635,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014965,"completed_at":"2026-09-14T09:31:53.360Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1309vm-test-run-nixbot-gitlab> gitlab # [ 237.030580] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.361Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29beef76558000541a0a3e73","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29beef76558000541a0a3e73: start","job_status":"start","queue_duration_s":0.675201,"scheduling_latency_s":0.675218}1310vm-test-run-nixbot-gitlab> gitlab # [ 237.044058] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"29beef76558000541a0a3e73","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-29beef76558000541a0a3e73: done: 0.015381 sec","job_status":"done","queue_duration_s":0.675201,"scheduling_latency_s":0.675218,"redis_calls":13,"redis_duration_s":0.002843,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001926,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009789,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015381,"completed_at":"2026-09-14T09:31:53.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1311vm-test-run-nixbot-gitlab> gitlab # [ 237.082785] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfbce01cc86c68183f4c9da7","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfbce01cc86c68183f4c9da7: start","job_status":"start","queue_duration_s":0.691944,"scheduling_latency_s":0.69196}1312vm-test-run-nixbot-gitlab> gitlab # [ 237.095165] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dfbce01cc86c68183f4c9da7","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dfbce01cc86c68183f4c9da7: done: 0.015638 sec","job_status":"done","queue_duration_s":0.691944,"scheduling_latency_s":0.69196,"redis_calls":13,"redis_duration_s":0.002626,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000895,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001731,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015638,"completed_at":"2026-09-14T09:31:53.394Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1313vm-test-run-nixbot-gitlab> gitlab # [ 237.133800] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.395Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"180c2638867056fb7a87b030","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-180c2638867056fb7a87b030: start","job_status":"start","queue_duration_s":0.708956,"scheduling_latency_s":0.708973}1314vm-test-run-nixbot-gitlab> gitlab # [ 237.146327] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.411Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"180c2638867056fb7a87b030","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-180c2638867056fb7a87b030: done: 0.015531 sec","job_status":"done","queue_duration_s":0.708956,"scheduling_latency_s":0.708973,"redis_calls":13,"redis_duration_s":0.002842,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000905,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015531,"completed_at":"2026-09-14T09:31:53.411Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1315vm-test-run-nixbot-gitlab> gitlab # [ 237.184961] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.412Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a524f2200ec7d6bdf32b1b9","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a524f2200ec7d6bdf32b1b9: start","job_status":"start","queue_duration_s":0.725981,"scheduling_latency_s":0.725998}1316vm-test-run-nixbot-gitlab> gitlab # [ 237.197201] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.427Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8a524f2200ec7d6bdf32b1b9","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8a524f2200ec7d6bdf32b1b9: done: 0.015119 sec","job_status":"done","queue_duration_s":0.725981,"scheduling_latency_s":0.725998,"redis_calls":13,"redis_duration_s":0.002802,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000951,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001851,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015119,"completed_at":"2026-09-14T09:31:53.427Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1317vm-test-run-nixbot-gitlab> gitlab # [ 237.235829] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.429Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d135762d66bc8343df6b7184","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d135762d66bc8343df6b7184: start","job_status":"start","queue_duration_s":0.742337,"scheduling_latency_s":0.742353}1318vm-test-run-nixbot-gitlab> gitlab # [ 237.249299] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.443Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d135762d66bc8343df6b7184","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d135762d66bc8343df6b7184: done: 0.014769 sec","job_status":"done","queue_duration_s":0.742337,"scheduling_latency_s":0.742353,"redis_calls":13,"redis_duration_s":0.002568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000938,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00163,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008858,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014769,"completed_at":"2026-09-14T09:31:53.443Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1319vm-test-run-nixbot-gitlab> gitlab # [ 237.287902] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.445Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b675361680bf065914fbce28","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b675361680bf065914fbce28: start","job_status":"start","queue_duration_s":0.758943,"scheduling_latency_s":0.758961}1320vm-test-run-nixbot-gitlab> gitlab # [ 237.300493] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b675361680bf065914fbce28","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b675361680bf065914fbce28: done: 0.015655 sec","job_status":"done","queue_duration_s":0.758943,"scheduling_latency_s":0.758961,"redis_calls":13,"redis_duration_s":0.002553,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001637,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010289,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015655,"completed_at":"2026-09-14T09:31:53.461Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1321vm-test-run-nixbot-gitlab> gitlab # [ 237.339290] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0f7be2c70d4a6e5b93f8ed4","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0f7be2c70d4a6e5b93f8ed4: start","job_status":"start","queue_duration_s":0.775949,"scheduling_latency_s":0.775966}1322vm-test-run-nixbot-gitlab> gitlab # [ 237.351504] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b0f7be2c70d4a6e5b93f8ed4","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b0f7be2c70d4a6e5b93f8ed4: done: 0.017515 sec","job_status":"done","queue_duration_s":0.775949,"scheduling_latency_s":0.775966,"redis_calls":13,"redis_duration_s":0.004013,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000917,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003096,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010936,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017515,"completed_at":"2026-09-14T09:31:53.480Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1323vm-test-run-nixbot-gitlab> gitlab # [ 237.390283] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"829d8c9f36a552e94ef8d0a7","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-829d8c9f36a552e94ef8d0a7: start","job_status":"start","queue_duration_s":0.794857,"scheduling_latency_s":0.794874}1324vm-test-run-nixbot-gitlab> gitlab # [ 237.402851] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.497Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"829d8c9f36a552e94ef8d0a7","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-829d8c9f36a552e94ef8d0a7: done: 0.015556 sec","job_status":"done","queue_duration_s":0.794857,"scheduling_latency_s":0.794874,"redis_calls":13,"redis_duration_s":0.0026490000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000894,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001755,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01021,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015556,"completed_at":"2026-09-14T09:31:53.496Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1325vm-test-run-nixbot-gitlab> gitlab # [ 237.441665] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"880e4d7dcc2db50188147012","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-880e4d7dcc2db50188147012: start","job_status":"start","queue_duration_s":0.811829,"scheduling_latency_s":0.811845}1326vm-test-run-nixbot-gitlab> gitlab # [ 237.454770] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"880e4d7dcc2db50188147012","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-880e4d7dcc2db50188147012: done: 0.015507 sec","job_status":"done","queue_duration_s":0.811829,"scheduling_latency_s":0.811845,"redis_calls":13,"redis_duration_s":0.00261,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000887,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001723,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009051,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015507,"completed_at":"2026-09-14T09:31:53.513Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1327vm-test-run-nixbot-gitlab> gitlab # [ 237.493080] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2db9a517d7de069ed3e0dbd6","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2db9a517d7de069ed3e0dbd6: start","job_status":"start","queue_duration_s":0.829662,"scheduling_latency_s":0.829679}1328vm-test-run-nixbot-gitlab> gitlab # [ 237.505188] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.531Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2db9a517d7de069ed3e0dbd6","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2db9a517d7de069ed3e0dbd6: done: 0.015 sec","job_status":"done","queue_duration_s":0.829662,"scheduling_latency_s":0.829679,"redis_calls":13,"redis_duration_s":0.0026420000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001753,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009565,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015,"completed_at":"2026-09-14T09:31:53.531Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1329vm-test-run-nixbot-gitlab> gitlab # [ 237.543911] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.532Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"848a07cd459b904fc0048ebc","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-848a07cd459b904fc0048ebc: start","job_status":"start","queue_duration_s":0.846003,"scheduling_latency_s":0.846019}1330vm-test-run-nixbot-gitlab> gitlab # [ 237.556271] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.548Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"848a07cd459b904fc0048ebc","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-848a07cd459b904fc0048ebc: done: 0.015624 sec","job_status":"done","queue_duration_s":0.846003,"scheduling_latency_s":0.846019,"redis_calls":13,"redis_duration_s":0.003136,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002201,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009842,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015624,"completed_at":"2026-09-14T09:31:53.548Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1331vm-test-run-nixbot-gitlab> gitlab # [ 237.594419] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.549Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fce6c0b5859139275cbe15c1","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fce6c0b5859139275cbe15c1: start","job_status":"start","queue_duration_s":0.863052,"scheduling_latency_s":0.863068}1332vm-test-run-nixbot-gitlab> gitlab # [ 237.606623] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.565Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"fce6c0b5859139275cbe15c1","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-fce6c0b5859139275cbe15c1: done: 0.015409 sec","job_status":"done","queue_duration_s":0.863052,"scheduling_latency_s":0.863068,"redis_calls":13,"redis_duration_s":0.002869,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000944,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009908,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015409,"completed_at":"2026-09-14T09:31:53.565Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1333vm-test-run-nixbot-gitlab> gitlab # [ 237.645054] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.566Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56702f399906573e7bcb28b3","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56702f399906573e7bcb28b3: start","job_status":"start","queue_duration_s":0.879832,"scheduling_latency_s":0.879849}1334vm-test-run-nixbot-gitlab> gitlab # [ 237.658226] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.582Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56702f399906573e7bcb28b3","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56702f399906573e7bcb28b3: done: 0.015655 sec","job_status":"done","queue_duration_s":0.879832,"scheduling_latency_s":0.879849,"redis_calls":13,"redis_duration_s":0.002662,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001725,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009024,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015655,"completed_at":"2026-09-14T09:31:53.582Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1335vm-test-run-nixbot-gitlab> gitlab # [ 237.696334] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.583Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffd72a3a8a490d588c394910","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffd72a3a8a490d588c394910: start","job_status":"start","queue_duration_s":0.896916,"scheduling_latency_s":0.896932}1336vm-test-run-nixbot-gitlab> gitlab # [ 237.708397] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.598Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffd72a3a8a490d588c394910","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffd72a3a8a490d588c394910: done: 0.014984 sec","job_status":"done","queue_duration_s":0.896916,"scheduling_latency_s":0.896932,"redis_calls":13,"redis_duration_s":0.002767,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000934,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001833,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014984,"completed_at":"2026-09-14T09:31:53.598Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1337vm-test-run-nixbot-gitlab> gitlab # [ 237.747007] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.599Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7aacd4ea8755b93bb17561c","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7aacd4ea8755b93bb17561c: start","job_status":"start","queue_duration_s":0.913248,"scheduling_latency_s":0.913265}1338vm-test-run-nixbot-gitlab> gitlab # [ 237.759466] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.614Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d7aacd4ea8755b93bb17561c","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d7aacd4ea8755b93bb17561c: done: 0.014552 sec","job_status":"done","queue_duration_s":0.913248,"scheduling_latency_s":0.913265,"redis_calls":13,"redis_duration_s":0.002568,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000904,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001664,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009221,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014552,"completed_at":"2026-09-14T09:31:53.614Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1339vm-test-run-nixbot-gitlab> gitlab # [ 237.798552] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61d6fa944defe0c707eb422e","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61d6fa944defe0c707eb422e: start","job_status":"start","queue_duration_s":0.92915,"scheduling_latency_s":0.929165}1340vm-test-run-nixbot-gitlab> gitlab # [ 237.810845] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.630Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"61d6fa944defe0c707eb422e","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-61d6fa944defe0c707eb422e: done: 0.014696 sec","job_status":"done","queue_duration_s":0.92915,"scheduling_latency_s":0.929165,"redis_calls":13,"redis_duration_s":0.002677,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001745,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008996,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014696,"completed_at":"2026-09-14T09:31:53.630Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1341vm-test-run-nixbot-gitlab> gitlab # [ 237.849166] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.632Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1609b00f933a3953894cf065","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1609b00f933a3953894cf065: start","job_status":"start","queue_duration_s":0.945522,"scheduling_latency_s":0.945539}1342vm-test-run-nixbot-gitlab> gitlab # [ 237.862347] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.647Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1609b00f933a3953894cf065","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1609b00f933a3953894cf065: done: 0.015192 sec","job_status":"done","queue_duration_s":0.945522,"scheduling_latency_s":0.945539,"redis_calls":13,"redis_duration_s":0.003125,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001252,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001873,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00919,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015192,"completed_at":"2026-09-14T09:31:53.647Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1343vm-test-run-nixbot-gitlab> gitlab # [ 237.900645] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.653Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"310c5b9d9be4ead50208d945","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-310c5b9d9be4ead50208d945: start","job_status":"start","queue_duration_s":0.966848,"scheduling_latency_s":0.966867}1344vm-test-run-nixbot-gitlab> gitlab # [ 237.912901] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.670Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"310c5b9d9be4ead50208d945","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-310c5b9d9be4ead50208d945: done: 0.017121 sec","job_status":"done","queue_duration_s":0.966848,"scheduling_latency_s":0.966867,"redis_calls":13,"redis_duration_s":0.0036260000000000003,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000916,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00271,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010482,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.017121,"completed_at":"2026-09-14T09:31:53.670Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1345vm-test-run-nixbot-gitlab> gitlab # [ 237.951108] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.671Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"801c24eb87729360daf565e7","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-801c24eb87729360daf565e7: start","job_status":"start","queue_duration_s":0.985191,"scheduling_latency_s":0.985208}1346vm-test-run-nixbot-gitlab> gitlab # [ 237.963381] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.686Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"801c24eb87729360daf565e7","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-801c24eb87729360daf565e7: done: 0.014891 sec","job_status":"done","queue_duration_s":0.985191,"scheduling_latency_s":0.985208,"redis_calls":13,"redis_duration_s":0.002293,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000728,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001565,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009821,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014891,"completed_at":"2026-09-14T09:31:53.686Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1347vm-test-run-nixbot-gitlab> gitlab # [ 238.002223] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.687Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e034d34abba5ccdc74e3d8f","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e034d34abba5ccdc74e3d8f: start","job_status":"start","queue_duration_s":1.001212,"scheduling_latency_s":1.001229}1348vm-test-run-nixbot-gitlab> gitlab # [ 238.014595] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e034d34abba5ccdc74e3d8f","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e034d34abba5ccdc74e3d8f: done: 0.014683 sec","job_status":"done","queue_duration_s":1.001212,"scheduling_latency_s":1.001229,"redis_calls":13,"redis_duration_s":0.001987,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000594,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001393,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009664,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014683,"completed_at":"2026-09-14T09:31:53.702Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1349vm-test-run-nixbot-gitlab> gitlab # [ 238.053295] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.703Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76bee8c446ef76c288fe73f8","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76bee8c446ef76c288fe73f8: start","job_status":"start","queue_duration_s":1.017264,"scheduling_latency_s":1.017281}1350vm-test-run-nixbot-gitlab> gitlab # [ 238.066556] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.717Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"76bee8c446ef76c288fe73f8","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-76bee8c446ef76c288fe73f8: done: 0.013809 sec","job_status":"done","queue_duration_s":1.017264,"scheduling_latency_s":1.017281,"redis_calls":13,"redis_duration_s":0.001597,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000691,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009504,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013809,"completed_at":"2026-09-14T09:31:53.717Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1351vm-test-run-nixbot-gitlab> gitlab # [ 238.105356] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.718Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4502dc194a1e887ee6b3533","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4502dc194a1e887ee6b3533: start","job_status":"start","queue_duration_s":1.03223,"scheduling_latency_s":1.032247}1352vm-test-run-nixbot-gitlab> gitlab # [ 238.117650] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.732Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d4502dc194a1e887ee6b3533","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d4502dc194a1e887ee6b3533: done: 0.013876 sec","job_status":"done","queue_duration_s":1.03223,"scheduling_latency_s":1.032247,"redis_calls":13,"redis_duration_s":0.001529,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000596,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009606,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013876,"completed_at":"2026-09-14T09:31:53.732Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1353vm-test-run-nixbot-gitlab> gitlab # [ 238.156224] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.733Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da6fd94685d10147868dfc9f","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da6fd94685d10147868dfc9f: start","job_status":"start","queue_duration_s":1.047191,"scheduling_latency_s":1.047208}1354vm-test-run-nixbot-gitlab> gitlab # [ 238.168350] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.748Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"da6fd94685d10147868dfc9f","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-da6fd94685d10147868dfc9f: done: 0.014386 sec","job_status":"done","queue_duration_s":1.047191,"scheduling_latency_s":1.047208,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000924,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010035,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014386,"completed_at":"2026-09-14T09:31:53.748Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1355vm-test-run-nixbot-gitlab> gitlab # [ 238.206702] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.749Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"caf07bd32905175af18b1b7b","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-caf07bd32905175af18b1b7b: start","job_status":"start","queue_duration_s":1.062703,"scheduling_latency_s":1.06272}1356vm-test-run-nixbot-gitlab> gitlab # [ 238.218844] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.763Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"caf07bd32905175af18b1b7b","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-caf07bd32905175af18b1b7b: done: 0.013885 sec","job_status":"done","queue_duration_s":1.062703,"scheduling_latency_s":1.06272,"redis_calls":13,"redis_duration_s":0.001416,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013885,"completed_at":"2026-09-14T09:31:53.763Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1357vm-test-run-nixbot-gitlab> gitlab # [ 238.257630] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.764Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4ad78a55a9726643673e305","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4ad78a55a9726643673e305: start","job_status":"start","queue_duration_s":1.0779,"scheduling_latency_s":1.077918}1358vm-test-run-nixbot-gitlab> gitlab # [ 238.270786] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e4ad78a55a9726643673e305","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e4ad78a55a9726643673e305: done: 0.014067 sec","job_status":"done","queue_duration_s":1.0779,"scheduling_latency_s":1.077918,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009368,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014067,"completed_at":"2026-09-14T09:31:53.778Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1359vm-test-run-nixbot-gitlab> gitlab # [ 238.309594] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fc8404b7f8b02fc6f758f58","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fc8404b7f8b02fc6f758f58: start","job_status":"start","queue_duration_s":1.09305,"scheduling_latency_s":1.093067}1360vm-test-run-nixbot-gitlab> gitlab # [ 238.321627] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.793Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5fc8404b7f8b02fc6f758f58","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5fc8404b7f8b02fc6f758f58: done: 0.014204 sec","job_status":"done","queue_duration_s":1.09305,"scheduling_latency_s":1.093067,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000534,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009872,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014204,"completed_at":"2026-09-14T09:31:53.793Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1361vm-test-run-nixbot-gitlab> gitlab # [ 238.360240] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7627e6a5cdb541bcf20f4f3f","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7627e6a5cdb541bcf20f4f3f: start","job_status":"start","queue_duration_s":1.108332,"scheduling_latency_s":1.108349}1362vm-test-run-nixbot-gitlab> gitlab # [ 238.372436] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.808Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7627e6a5cdb541bcf20f4f3f","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7627e6a5cdb541bcf20f4f3f: done: 0.014002 sec","job_status":"done","queue_duration_s":1.108332,"scheduling_latency_s":1.108349,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000927,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014002,"completed_at":"2026-09-14T09:31:53.808Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1363vm-test-run-nixbot-gitlab> gitlab # [ 238.410932] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa17489ff3323c27dee6fba5","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa17489ff3323c27dee6fba5: start","job_status":"start","queue_duration_s":1.123456,"scheduling_latency_s":1.123473}1364vm-test-run-nixbot-gitlab> gitlab # [ 238.423385] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.824Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa17489ff3323c27dee6fba5","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa17489ff3323c27dee6fba5: done: 0.014206 sec","job_status":"done","queue_duration_s":1.123456,"scheduling_latency_s":1.123473,"redis_calls":13,"redis_duration_s":0.001485,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000968,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009946,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014206,"completed_at":"2026-09-14T09:31:53.824Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1365vm-test-run-nixbot-gitlab> gitlab # [ 238.462356] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.825Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac329434769548838c0c3017","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac329434769548838c0c3017: start","job_status":"start","queue_duration_s":1.138865,"scheduling_latency_s":1.138883}1366vm-test-run-nixbot-gitlab> gitlab # [ 238.475575] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.839Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ac329434769548838c0c3017","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ac329434769548838c0c3017: done: 0.014465 sec","job_status":"done","queue_duration_s":1.138865,"scheduling_latency_s":1.138883,"redis_calls":13,"redis_duration_s":0.00141,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009895,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014465,"completed_at":"2026-09-14T09:31:53.839Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1367vm-test-run-nixbot-gitlab> gitlab # [ 238.514258] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.841Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc5ae52544328373eec359d8","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc5ae52544328373eec359d8: start","job_status":"start","queue_duration_s":1.154418,"scheduling_latency_s":1.154434}1368vm-test-run-nixbot-gitlab> gitlab # [ 238.526483] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.855Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dc5ae52544328373eec359d8","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dc5ae52544328373eec359d8: done: 0.014275 sec","job_status":"done","queue_duration_s":1.154418,"scheduling_latency_s":1.154434,"redis_calls":13,"redis_duration_s":0.001454,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000953,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010061,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014275,"completed_at":"2026-09-14T09:31:53.855Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1369vm-test-run-nixbot-gitlab> gitlab # [ 238.564736] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.856Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56d9ec64c57f403d681fb2cc","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56d9ec64c57f403d681fb2cc: start","job_status":"start","queue_duration_s":1.169745,"scheduling_latency_s":1.169762}1370vm-test-run-nixbot-gitlab> gitlab # [ 238.576987] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.870Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"56d9ec64c57f403d681fb2cc","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-56d9ec64c57f403d681fb2cc: done: 0.013976 sec","job_status":"done","queue_duration_s":1.169745,"scheduling_latency_s":1.169762,"redis_calls":13,"redis_duration_s":0.001411,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000903,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009532,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013976,"completed_at":"2026-09-14T09:31:53.870Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1371vm-test-run-nixbot-gitlab> gitlab # [ 238.615598] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.871Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c188edfec9e7eaad12d173a","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c188edfec9e7eaad12d173a: start","job_status":"start","queue_duration_s":1.184776,"scheduling_latency_s":1.184792}1372vm-test-run-nixbot-gitlab> gitlab # [ 238.627950] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.885Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c188edfec9e7eaad12d173a","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c188edfec9e7eaad12d173a: done: 0.014078 sec","job_status":"done","queue_duration_s":1.184776,"scheduling_latency_s":1.184792,"redis_calls":13,"redis_duration_s":0.0014269999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000897,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009458,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014078,"completed_at":"2026-09-14T09:31:53.885Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1373vm-test-run-nixbot-gitlab> gitlab # [ 238.666817] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.886Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e9eaaaa1cea1969916d9351","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e9eaaaa1cea1969916d9351: start","job_status":"start","queue_duration_s":1.200114,"scheduling_latency_s":1.200131}1374vm-test-run-nixbot-gitlab> gitlab # [ 238.679932] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.900Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3e9eaaaa1cea1969916d9351","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3e9eaaaa1cea1969916d9351: done: 0.014074 sec","job_status":"done","queue_duration_s":1.200114,"scheduling_latency_s":1.200131,"redis_calls":13,"redis_duration_s":0.001737,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000804,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000933,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009913,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014074,"completed_at":"2026-09-14T09:31:53.900Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1375vm-test-run-nixbot-gitlab> gitlab # [ 238.718703] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9cec8b021440bbffb7adb81","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9cec8b021440bbffb7adb81: start","job_status":"start","queue_duration_s":1.215299,"scheduling_latency_s":1.215316}1376vm-test-run-nixbot-gitlab> gitlab # [ 238.731146] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.915Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a9cec8b021440bbffb7adb81","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a9cec8b021440bbffb7adb81: done: 0.013709 sec","job_status":"done","queue_duration_s":1.215299,"scheduling_latency_s":1.215316,"redis_calls":13,"redis_duration_s":0.001399,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013709,"completed_at":"2026-09-14T09:31:53.915Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1377vm-test-run-nixbot-gitlab> gitlab # [ 238.769710] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f96ccbb5119c0c16dd80657","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f96ccbb5119c0c16dd80657: start","job_status":"start","queue_duration_s":1.230069,"scheduling_latency_s":1.230086}1378vm-test-run-nixbot-gitlab> gitlab # [ 238.781810] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0f96ccbb5119c0c16dd80657","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0f96ccbb5119c0c16dd80657: done: 0.013902 sec","job_status":"done","queue_duration_s":1.230069,"scheduling_latency_s":1.230086,"redis_calls":13,"redis_duration_s":0.001509,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000989,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009667,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013902,"completed_at":"2026-09-14T09:31:53.930Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1379vm-test-run-nixbot-gitlab> gitlab # [ 238.820628] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.931Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"527076056ebe7aaf22b9ef0e","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-527076056ebe7aaf22b9ef0e: start","job_status":"start","queue_duration_s":1.24503,"scheduling_latency_s":1.245046}1380vm-test-run-nixbot-gitlab> gitlab # [ 238.832812] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"527076056ebe7aaf22b9ef0e","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-527076056ebe7aaf22b9ef0e: done: 0.014234 sec","job_status":"done","queue_duration_s":1.24503,"scheduling_latency_s":1.245046,"redis_calls":13,"redis_duration_s":0.001624,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00111,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009653,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014234,"completed_at":"2026-09-14T09:31:53.945Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1381vm-test-run-nixbot-gitlab> gitlab # [ 238.872172] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.947Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35874f0268b37d5c68616ffb","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35874f0268b37d5c68616ffb: start","job_status":"start","queue_duration_s":1.260536,"scheduling_latency_s":1.260553}1382vm-test-run-nixbot-gitlab> gitlab # [ 238.909381] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"35874f0268b37d5c68616ffb","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-35874f0268b37d5c68616ffb: done: 0.014646 sec","job_status":"done","queue_duration_s":1.260536,"scheduling_latency_s":1.260553,"redis_calls":13,"redis_duration_s":0.001464,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000958,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010442,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014646,"completed_at":"2026-09-14T09:31:53.961Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1383vm-test-run-nixbot-gitlab> gitlab # [ 238.995867] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.963Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79da71fe995ab964e8c5505f","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79da71fe995ab964e8c5505f: start","job_status":"start","queue_duration_s":1.276695,"scheduling_latency_s":1.276712}1384vm-test-run-nixbot-gitlab> gitlab # [ 239.015219] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.978Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"79da71fe995ab964e8c5505f","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-79da71fe995ab964e8c5505f: done: 0.01473 sec","job_status":"done","queue_duration_s":1.276695,"scheduling_latency_s":1.276712,"redis_calls":13,"redis_duration_s":0.0014659999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000544,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01473,"completed_at":"2026-09-14T09:31:53.978Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1385vm-test-run-nixbot-gitlab> gitlab # [ 239.060195] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.979Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4375e1469cc8dbe5a678fbad","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4375e1469cc8dbe5a678fbad: start","job_status":"start","queue_duration_s":1.29308,"scheduling_latency_s":1.293097}1386vm-test-run-nixbot-gitlab> gitlab # [ 239.072410] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4375e1469cc8dbe5a678fbad","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4375e1469cc8dbe5a678fbad: done: 0.01524 sec","job_status":"done","queue_duration_s":1.29308,"scheduling_latency_s":1.293097,"redis_calls":13,"redis_duration_s":0.0018570000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000906,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010884,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01524,"completed_at":"2026-09-14T09:31:53.994Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1387vm-test-run-nixbot-gitlab> gitlab # [ 239.111385] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:53.996Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dcaeda3d50454ee3038388b","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dcaeda3d50454ee3038388b: start","job_status":"start","queue_duration_s":1.309338,"scheduling_latency_s":1.309354}1388vm-test-run-nixbot-gitlab> gitlab # [ 239.125531] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:54.011Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9dcaeda3d50454ee3038388b","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9dcaeda3d50454ee3038388b: done: 0.015271 sec","job_status":"done","queue_duration_s":1.309338,"scheduling_latency_s":1.309354,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000951,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010748,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015271,"completed_at":"2026-09-14T09:31:54.011Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1389vm-test-run-nixbot-gitlab> gitlab # [ 239.197607] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:54.012Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"588017e84fdd111aa5d4e7cc","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-588017e84fdd111aa5d4e7cc: start","job_status":"start","queue_duration_s":1.325684,"scheduling_latency_s":1.325701}1390vm-test-run-nixbot-gitlab> gitlab # [ 239.224873] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:31:54.027Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"588017e84fdd111aa5d4e7cc","created_at":"2026-09-14T09:31:52.593Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-8ded784a4dd643f4","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"a3c7d575334068db9f8e00d4320e5e04","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:31:52.686Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-588017e84fdd111aa5d4e7cc: done: 0.015194 sec","job_status":"done","queue_duration_s":1.325684,"scheduling_latency_s":1.325701,"redis_calls":13,"redis_duration_s":0.001459,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000928,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010169,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015194,"completed_at":"2026-09-14T09:31:54.027Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1391vm-test-run-nixbot-gitlab> gitlab # [ 247.517991] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:04.353Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"16af184cbb7b3567c70a17ee","created_at":"2026-09-14T09:32:04.336Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"800befdd904f776af118ec7bebdd4099","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.349Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-16af184cbb7b3567c70a17ee: start","job_status":"start","queue_duration_s":0.00312,"scheduling_latency_s":0.003179}1392vm-test-run-nixbot-gitlab> gitlab # [ 247.668329] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:04.503Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"16af184cbb7b3567c70a17ee","created_at":"2026-09-14T09:32:04.336Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"800befdd904f776af118ec7bebdd4099","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.349Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-16af184cbb7b3567c70a17ee: done: 0.150377 sec","job_status":"done","queue_duration_s":0.00312,"scheduling_latency_s":0.003179,"redis_calls":9,"redis_duration_s":0.021397,"redis_read_bytes":7,"redis_write_bytes":1087,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011907,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.00949,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.034775,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00823144,"exclusive_lock_hold_duration_s":0.00744904,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.150377,"completed_at":"2026-09-14T09:32:04.503Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002115,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1393vm-test-run-nixbot-gitlab> gitlab # [ 247.764098] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:04.516Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8c06608e0dffcd0601e6cfe0","created_at":"2026-09-14T09:32:04.415Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c1889cbcdb35a15b92515315837abb3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.429Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8c06608e0dffcd0601e6cfe0: start","job_status":"start","queue_duration_s":0.087157,"scheduling_latency_s":0.087206}1394vm-test-run-nixbot-gitlab> gitlab # [ 247.786915] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:04.545Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1395vm-test-run-nixbot-gitlab> gitlab # [ 247.791415] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:04.573Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"8c06608e0dffcd0601e6cfe0","created_at":"2026-09-14T09:32:04.415Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7c1889cbcdb35a15b92515315837abb3","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.429Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-8c06608e0dffcd0601e6cfe0: done: 0.05688 sec","job_status":"done","queue_duration_s":0.087157,"scheduling_latency_s":0.087206,"redis_calls":7,"redis_duration_s":0.003247,"redis_read_bytes":5,"redis_write_bytes":771,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002528,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000719,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023784,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.05688,"completed_at":"2026-09-14T09:32:04.573Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1396vm-test-run-nixbot-gitlab> gitlab # [ 247.836273] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:04.577Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"3fed042ddfb1b3cf90a27b5d","created_at":"2026-09-14T09:32:04.486Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14c3f2bdd50b0025b9e66959cdebf262","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.496Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-3fed042ddfb1b3cf90a27b5d: start","job_status":"start","queue_duration_s":0.080833,"scheduling_latency_s":0.08088}1397vm-test-run-nixbot-gitlab> gitlab # [ 247.893420] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:04.729Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"3fed042ddfb1b3cf90a27b5d","created_at":"2026-09-14T09:32:04.486Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"14c3f2bdd50b0025b9e66959cdebf262","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.496Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-3fed042ddfb1b3cf90a27b5d: done: 0.151346 sec","job_status":"done","queue_duration_s":0.080833,"scheduling_latency_s":0.08088,"redis_calls":9,"redis_duration_s":0.018099,"redis_read_bytes":7,"redis_write_bytes":1169,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002418,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.015681,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.026,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.026,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.04612,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00150586,"exclusive_lock_hold_duration_s":0.03065434,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.151346,"completed_at":"2026-09-14T09:32:04.728Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.041861,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1398vm-test-run-nixbot-gitlab> gitlab # [ 247.966845] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:04.764Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"39480661bc1e41579741dbd6","created_at":"2026-09-14T09:32:04.518Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ba0a17d37cb0f105164c9b3224c4ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T09:32:04.524Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-39480661bc1e41579741dbd6: start","job_status":"start","queue_duration_s":0.239344,"scheduling_latency_s":0.239393}1399vm-test-run-nixbot-gitlab> gitlab # [ 248.033176] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:04.869Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1400vm-test-run-nixbot-gitlab> gitlab # [ 248.056824] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:04.892Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"39480661bc1e41579741dbd6","created_at":"2026-09-14T09:32:04.518Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"1ba0a17d37cb0f105164c9b3224c4ec9","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T09:32:04.524Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-39480661bc1e41579741dbd6: done: 0.128374 sec","job_status":"done","queue_duration_s":0.239344,"scheduling_latency_s":0.239393,"redis_calls":7,"redis_duration_s":0.00414,"redis_read_bytes":5,"redis_write_bytes":806,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002882,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001258,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.128374,"completed_at":"2026-09-14T09:32:04.892Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1401vm-test-run-nixbot-gitlab> gitlab # [ 248.132775] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:04.901Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d2d949fe69d5ba732f201f42","created_at":"2026-09-14T09:32:04.564Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"567332ea67cb57718ff7c4871308fbdf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T09:32:04.570Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d2d949fe69d5ba732f201f42: start","job_status":"start","queue_duration_s":0.331088,"scheduling_latency_s":0.331136}1402vm-test-run-nixbot-gitlab> gitlab # [ 248.165111] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.000Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"d2d949fe69d5ba732f201f42","created_at":"2026-09-14T09:32:04.564Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"567332ea67cb57718ff7c4871308fbdf","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T09:32:04.570Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-d2d949fe69d5ba732f201f42: done: 0.099495 sec","job_status":"done","queue_duration_s":0.331088,"scheduling_latency_s":0.331136,"redis_calls":7,"redis_duration_s":0.028565,"redis_read_bytes":5,"redis_write_bytes":741,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.025986,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002579,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.006,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.006,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.040338,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.099495,"completed_at":"2026-09-14T09:32:05.000Z","load_balancing_strategy":"primary","db_duration_s":0.006245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1403vm-test-run-nixbot-gitlab> gitlab # [ 248.207572] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"602083fbeea18c260f6689c9","created_at":"2026-09-14T09:32:04.612Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.661Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-602083fbeea18c260f6689c9: start","job_status":"start","queue_duration_s":0.370141,"scheduling_latency_s":0.370192}1404vm-test-run-nixbot-gitlab> gitlab # [ 248.449096] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.285Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleDeleteObjectsCronWorker","jid":"602083fbeea18c260f6689c9","created_at":"2026-09-14T09:32:04.612Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:8251d4193fad694e50c4958d17fdca56b6fb205fa6961a4b1ccb7cd497bc09c1","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.661Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleDeleteObjectsCronWorker JID-602083fbeea18c260f6689c9: done: 0.253424 sec","job_status":"done","queue_duration_s":0.370141,"scheduling_latency_s":0.370192,"redis_calls":65,"redis_duration_s":0.09048,"redis_read_bytes":114,"redis_write_bytes":41282,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.009116,"redis_feature_flag_read_bytes":4,"redis_feature_flag_write_bytes":656,"redis_queues_calls":2,"redis_queues_duration_s":0.000993,"redis_queues_read_bytes":3,"redis_queues_write_bytes":36985,"redis_queues_metadata_calls":56,"redis_queues_metadata_duration_s":0.077976,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3374,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.002395,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":267,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.132131,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00037548,"duration_s":0.253424,"completed_at":"2026-09-14T09:32:05.285Z","load_balancing_strategy":"primary","db_duration_s":0.002977,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1405vm-test-run-nixbot-gitlab> gitlab # [ 248.550631] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.287Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"990cc437e6b3f555a33a8dad","created_at":"2026-09-14T09:32:04.685Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aeb388a8faaa9e7941fe6a2b448d38fe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.692Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-990cc437e6b3f555a33a8dad: start","job_status":"start","queue_duration_s":0.59427,"scheduling_latency_s":0.594299}1406vm-test-run-nixbot-gitlab> gitlab # [ 248.575132] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.302Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"990cc437e6b3f555a33a8dad","created_at":"2026-09-14T09:32:04.685Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aeb388a8faaa9e7941fe6a2b448d38fe","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.692Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-990cc437e6b3f555a33a8dad: done: 0.015756 sec","job_status":"done","queue_duration_s":0.59427,"scheduling_latency_s":0.594299,"redis_calls":7,"redis_duration_s":0.0018030000000000001,"redis_read_bytes":5,"redis_write_bytes":831,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001319,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000484,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015756,"completed_at":"2026-09-14T09:32:05.302Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1407vm-test-run-nixbot-gitlab> gitlab # [ 248.626720] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.304Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"74c750c31108b907e63db5d7","created_at":"2026-09-14T09:32:04.700Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80e87d081b4479501182fcff25d6cca4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.710Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-74c750c31108b907e63db5d7: start","job_status":"start","queue_duration_s":0.593638,"scheduling_latency_s":0.593665}1408vm-test-run-nixbot-gitlab> gitlab # [ 248.641426] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.319Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"74c750c31108b907e63db5d7","created_at":"2026-09-14T09:32:04.700Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"80e87d081b4479501182fcff25d6cca4","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.710Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-74c750c31108b907e63db5d7: done: 0.015103 sec","job_status":"done","queue_duration_s":0.593638,"scheduling_latency_s":0.593665,"redis_calls":7,"redis_duration_s":0.001745,"redis_read_bytes":5,"redis_write_bytes":776,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001258,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000487,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009031,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015103,"completed_at":"2026-09-14T09:32:05.319Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1409vm-test-run-nixbot-gitlab> gitlab # [ 248.681475] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.321Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"fe00152550634e4552dc29d3","created_at":"2026-09-14T09:32:04.719Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29f9c0a9667f9427aad98b49373f780d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.723Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-fe00152550634e4552dc29d3: start","job_status":"start","queue_duration_s":0.597831,"scheduling_latency_s":0.597861}1410vm-test-run-nixbot-gitlab> gitlab # [ 248.694877] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.355Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"fe00152550634e4552dc29d3","created_at":"2026-09-14T09:32:04.719Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"29f9c0a9667f9427aad98b49373f780d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.723Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-fe00152550634e4552dc29d3: done: 0.033994 sec","job_status":"done","queue_duration_s":0.597831,"scheduling_latency_s":0.597861,"redis_calls":14,"redis_duration_s":0.002414,"redis_read_bytes":16,"redis_write_bytes":4030,"redis_queues_calls":2,"redis_queues_duration_s":0.000234,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.001541,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000639,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.022904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.033994,"completed_at":"2026-09-14T09:32:05.355Z","load_balancing_strategy":"primary","db_duration_s":0.005185,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1411vm-test-run-nixbot-gitlab> gitlab # [ 248.735429] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.356Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"15ab2a211d8472f51d953477","created_at":"2026-09-14T09:32:04.738Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e2e63ddaaa7dadb2dfc4137e8863f89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.745Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-15ab2a211d8472f51d953477: start","job_status":"start","queue_duration_s":0.61145,"scheduling_latency_s":0.61148}1412vm-test-run-nixbot-gitlab> gitlab # [ 248.766475] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.602Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"15ab2a211d8472f51d953477","created_at":"2026-09-14T09:32:04.738Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4e2e63ddaaa7dadb2dfc4137e8863f89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.745Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-15ab2a211d8472f51d953477: done: 0.246058 sec","job_status":"done","queue_duration_s":0.61145,"scheduling_latency_s":0.61148,"redis_calls":11,"redis_duration_s":0.001921,"redis_read_bytes":9,"redis_write_bytes":1262,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000339,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":275,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00076,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000822,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":130,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":130,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.048,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":130,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":84,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.048,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.179471,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00057808,"exclusive_lock_hold_duration_s":0.22692496,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"main","turbo_mode":false},"duration_s":0.246058,"completed_at":"2026-09-14T09:32:05.602Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.075081,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1413vm-test-run-nixbot-gitlab> gitlab # [ 248.810569] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.604Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"af500ebf8352d60504eb6fd8","created_at":"2026-09-14T09:32:04.763Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06f1bfa155141d261fe2c48d25ece8fa","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.769Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-af500ebf8352d60504eb6fd8: start","job_status":"start","queue_duration_s":0.834537,"scheduling_latency_s":0.834565}1414vm-test-run-nixbot-gitlab> gitlab # [ 249.151362] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.987Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"af500ebf8352d60504eb6fd8","created_at":"2026-09-14T09:32:04.763Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"06f1bfa155141d261fe2c48d25ece8fa","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.769Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-af500ebf8352d60504eb6fd8: done: 0.383325 sec","job_status":"done","queue_duration_s":0.834537,"scheduling_latency_s":0.834565,"redis_calls":562,"redis_duration_s":0.06123,"redis_read_bytes":560,"redis_write_bytes":48760,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000857,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.060373,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.355674,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.383325,"completed_at":"2026-09-14T09:32:05.987Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1415vm-test-run-nixbot-gitlab> gitlab # [ 249.247428] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.989Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"783080feeb3e2897c0d52b51","created_at":"2026-09-14T09:32:04.774Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66136f0bb06c633159f540ab7ac58473","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.778Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-783080feeb3e2897c0d52b51: start","job_status":"start","queue_duration_s":1.21048,"scheduling_latency_s":1.210506}1416vm-test-run-nixbot-gitlab> gitlab # [ 249.266411] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:05.997Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1417vm-test-run-nixbot-gitlab> gitlab # [ 249.270665] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.002Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"783080feeb3e2897c0d52b51","created_at":"2026-09-14T09:32:04.774Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"66136f0bb06c633159f540ab7ac58473","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.778Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-783080feeb3e2897c0d52b51: done: 0.013326 sec","job_status":"done","queue_duration_s":1.21048,"scheduling_latency_s":1.210506,"redis_calls":7,"redis_duration_s":0.0011560000000000001,"redis_read_bytes":5,"redis_write_bytes":766,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000342,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008148,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013326,"completed_at":"2026-09-14T09:32:06.002Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1418vm-test-run-nixbot-gitlab> gitlab # [ 249.312274] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.004Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"37331b7d2424132e1b078215","created_at":"2026-09-14T09:32:04.788Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa83221dae8e56fd311dcb8724b21719","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T09:32:04.791Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-37331b7d2424132e1b078215: start","job_status":"start","queue_duration_s":1.212142,"scheduling_latency_s":1.212165}1419vm-test-run-nixbot-gitlab> gitlab # [ 249.325440] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.011Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1420vm-test-run-nixbot-gitlab> gitlab # [ 249.329082] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.017Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"37331b7d2424132e1b078215","created_at":"2026-09-14T09:32:04.788Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa83221dae8e56fd311dcb8724b21719","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T09:32:04.791Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-37331b7d2424132e1b078215: done: 0.013291 sec","job_status":"done","queue_duration_s":1.212142,"scheduling_latency_s":1.212165,"redis_calls":7,"redis_duration_s":0.001306,"redis_read_bytes":5,"redis_write_bytes":801,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000381,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008179,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013291,"completed_at":"2026-09-14T09:32:06.017Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1421vm-test-run-nixbot-gitlab> gitlab # [ 249.368068] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.018Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d05c1d807c2283945c30fc17","created_at":"2026-09-14T09:32:04.798Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d24f9100f7a6d86b9d77f2318469ce45","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.801Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d05c1d807c2283945c30fc17: start","job_status":"start","queue_duration_s":1.217113,"scheduling_latency_s":1.217134}1422vm-test-run-nixbot-gitlab> gitlab # [ 249.383402] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.027Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1423vm-test-run-nixbot-gitlab> gitlab # [ 249.387231] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.032Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"d05c1d807c2283945c30fc17","created_at":"2026-09-14T09:32:04.798Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d24f9100f7a6d86b9d77f2318469ce45","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.801Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-d05c1d807c2283945c30fc17: done: 0.013646 sec","job_status":"done","queue_duration_s":1.217113,"scheduling_latency_s":1.217134,"redis_calls":7,"redis_duration_s":0.001299,"redis_read_bytes":5,"redis_write_bytes":821,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000908,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000391,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008001,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013646,"completed_at":"2026-09-14T09:32:06.032Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1424vm-test-run-nixbot-gitlab> gitlab # [ 249.427250] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.033Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2d6abff5dee2d8a0f5e3e6c6","created_at":"2026-09-14T09:32:04.807Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"175733b3e7acdf611ca2d04031af3378","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.810Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2d6abff5dee2d8a0f5e3e6c6: start","job_status":"start","queue_duration_s":1.223514,"scheduling_latency_s":1.223533}1425vm-test-run-nixbot-gitlab> gitlab # [ 249.441144] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.061Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"2d6abff5dee2d8a0f5e3e6c6","created_at":"2026-09-14T09:32:04.807Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"175733b3e7acdf611ca2d04031af3378","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.810Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-2d6abff5dee2d8a0f5e3e6c6: done: 0.027697 sec","job_status":"done","queue_duration_s":1.223514,"scheduling_latency_s":1.223533,"redis_calls":7,"redis_duration_s":0.001522,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001075,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000447,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.011,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.011,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009963,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.027697,"completed_at":"2026-09-14T09:32:06.061Z","load_balancing_strategy":"primary","db_duration_s":0.010928,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1426vm-test-run-nixbot-gitlab> gitlab # [ 249.481664] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.063Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"c0a0914ff0d314991ec8bbf1","created_at":"2026-09-14T09:32:04.833Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.835Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-c0a0914ff0d314991ec8bbf1: start","job_status":"start","queue_duration_s":1.228017,"scheduling_latency_s":1.228039}1427vm-test-run-nixbot-gitlab> gitlab # [ 249.494949] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.164Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"c0a0914ff0d314991ec8bbf1","created_at":"2026-09-14T09:32:04.833Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.835Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-c0a0914ff0d314991ec8bbf1: done: 0.101315 sec","job_status":"done","queue_duration_s":1.228017,"scheduling_latency_s":1.228039,"redis_calls":60,"redis_duration_s":0.019342,"redis_read_bytes":109,"redis_write_bytes":41109,"redis_queues_calls":2,"redis_queues_duration_s":0.000749,"redis_queues_read_bytes":4,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.017971,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000622,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.082556,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.101315,"completed_at":"2026-09-14T09:32:06.164Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1428vm-test-run-nixbot-gitlab> gitlab # [ 249.535624] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.166Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"108b181446fc17a3a12cf02c","created_at":"2026-09-14T09:32:04.845Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4717e8d9132a3392dc3d3dc5931ae80c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.853Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-108b181446fc17a3a12cf02c: start","job_status":"start","queue_duration_s":1.31348,"scheduling_latency_s":1.313498}1429vm-test-run-nixbot-gitlab> gitlab # [ 249.550587] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.203Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Users::MigrateRecordsToGhostUserInBatchesWorker","jid":"108b181446fc17a3a12cf02c","created_at":"2026-09-14T09:32:04.845Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"4717e8d9132a3392dc3d3dc5931ae80c","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4bdb3193c92ce2ad4e73652ad55816e507f3dd7f07576150fc7c08572353b9e8","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.853Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Users::MigrateRecordsToGhostUserInBatchesWorker JID-108b181446fc17a3a12cf02c: done: 0.03729 sec","job_status":"done","queue_duration_s":1.31348,"scheduling_latency_s":1.313498,"redis_calls":12,"redis_duration_s":0.00353,"redis_read_bytes":11,"redis_write_bytes":1562,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00051,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001648,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001372,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":591,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.019023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00058956,"exclusive_lock_hold_duration_s":0.0076316,"duration_s":0.03729,"completed_at":"2026-09-14T09:32:06.203Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004874,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1430vm-test-run-nixbot-gitlab> gitlab # [ 249.594391] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.207Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"cf7a852db80fba5b4f46b476","created_at":"2026-09-14T09:32:04.879Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd46fb05401c4ff912a2441c38d48ba4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.888Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-cf7a852db80fba5b4f46b476: start","job_status":"start","queue_duration_s":1.319031,"scheduling_latency_s":1.319077}1431vm-test-run-nixbot-gitlab> gitlab # [ 249.608416] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.249Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"cf7a852db80fba5b4f46b476","created_at":"2026-09-14T09:32:04.879Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"bd46fb05401c4ff912a2441c38d48ba4","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.888Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-cf7a852db80fba5b4f46b476: done: 0.041876 sec","job_status":"done","queue_duration_s":1.319031,"scheduling_latency_s":1.319077,"redis_calls":9,"redis_duration_s":0.003013,"redis_read_bytes":7,"redis_write_bytes":1072,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001619,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001394,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028887,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00113238,"exclusive_lock_hold_duration_s":0.00677668,"duration_s":0.041876,"completed_at":"2026-09-14T09:32:06.248Z","load_balancing_strategy":"primary","db_duration_s":0.001945,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1432vm-test-run-nixbot-gitlab> gitlab # [ 249.647959] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.251Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"18e0be44fe9a7389511bbc89","created_at":"2026-09-14T09:32:04.902Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94604483e43c629f7f995d7adb2f3557","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.912Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-18e0be44fe9a7389511bbc89: start","job_status":"start","queue_duration_s":1.338772,"scheduling_latency_s":1.338812}1433vm-test-run-nixbot-gitlab> gitlab # [ 249.662509] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.314Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ServiceDesk::CustomEmailVerificationCleanupWorker","jid":"18e0be44fe9a7389511bbc89","created_at":"2026-09-14T09:32:04.902Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"94604483e43c629f7f995d7adb2f3557","meta.root_caller_id":"Cronjob","meta.feature_category":"service_desk","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:521f52c3ade07cc9136cad2d9aca0ecb702f305a24b32b7c6ca1558624b4df26","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.912Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ServiceDesk::CustomEmailVerificationCleanupWorker JID-18e0be44fe9a7389511bbc89: done: 0.062595 sec","job_status":"done","queue_duration_s":1.338772,"scheduling_latency_s":1.338812,"redis_calls":10,"redis_duration_s":0.004255,"redis_read_bytes":9,"redis_write_bytes":1225,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000875,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":341,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.002564,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":634,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000816,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":250,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.041633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00094158,"duration_s":0.062595,"completed_at":"2026-09-14T09:32:06.314Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.006588,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1434vm-test-run-nixbot-gitlab> gitlab # [ 249.704248] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.318Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"42b1b7120454effaf9b82027","created_at":"2026-09-14T09:32:04.969Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e82edc5b4897cee4cb418667348c86ec","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.981Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-42b1b7120454effaf9b82027: start","job_status":"start","queue_duration_s":1.337728,"scheduling_latency_s":1.337775}1435vm-test-run-nixbot-gitlab> gitlab # [ 249.718585] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.360Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"42b1b7120454effaf9b82027","created_at":"2026-09-14T09:32:04.969Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"e82edc5b4897cee4cb418667348c86ec","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.981Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-42b1b7120454effaf9b82027: done: 0.042217 sec","job_status":"done","queue_duration_s":1.337728,"scheduling_latency_s":1.337775,"redis_calls":10,"redis_duration_s":0.003972,"redis_read_bytes":8,"redis_write_bytes":1239,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00232,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001652,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.027489,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00966102,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.042217,"completed_at":"2026-09-14T09:32:06.360Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004625,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1436vm-test-run-nixbot-gitlab> gitlab # [ 249.760856] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.363Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1eb3aa06af1b89e59427b71f","created_at":"2026-09-14T09:32:04.994Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6527f2bfc67e4fc5c51e0d6a3b718c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.997Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1eb3aa06af1b89e59427b71f: start","job_status":"start","queue_duration_s":1.365576,"scheduling_latency_s":1.365608}1437vm-test-run-nixbot-gitlab> gitlab # [ 249.775100] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.460Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"1eb3aa06af1b89e59427b71f","created_at":"2026-09-14T09:32:04.994Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"f6527f2bfc67e4fc5c51e0d6a3b718c7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:04.997Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-1eb3aa06af1b89e59427b71f: done: 0.097724 sec","job_status":"done","queue_duration_s":1.365576,"scheduling_latency_s":1.365608,"redis_calls":9,"redis_duration_s":0.023449,"redis_read_bytes":7,"redis_write_bytes":1162,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.021954,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001495,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.018,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.018,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00108614,"exclusive_lock_hold_duration_s":0.05475784,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.097724,"completed_at":"2026-09-14T09:32:06.460Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.04451,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1438vm-test-run-nixbot-gitlab> gitlab # [ 249.818899] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.462Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3aae2e4eb8b24b2b80fde1c0","created_at":"2026-09-14T09:32:05.031Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"372a9d65082acc78c45bd394362d3b34","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.037Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-3aae2e4eb8b24b2b80fde1c0: start","job_status":"start","queue_duration_s":1.424864,"scheduling_latency_s":1.424889}1439vm-test-run-nixbot-gitlab> gitlab # [ 249.833118] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.481Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"3aae2e4eb8b24b2b80fde1c0","created_at":"2026-09-14T09:32:05.031Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"372a9d65082acc78c45bd394362d3b34","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.037Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-3aae2e4eb8b24b2b80fde1c0: done: 0.018839 sec","job_status":"done","queue_duration_s":1.424864,"scheduling_latency_s":1.424889,"redis_calls":7,"redis_duration_s":0.001904,"redis_read_bytes":5,"redis_write_bytes":681,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001376,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000528,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010809,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018839,"completed_at":"2026-09-14T09:32:06.481Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001736,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1440vm-test-run-nixbot-gitlab> gitlab # [ 249.873041] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.483Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9fab5703239dabaf0e4d9e04","created_at":"2026-09-14T09:32:05.066Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71cd4445396c1ec33b78f21d6ba5739c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.073Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9fab5703239dabaf0e4d9e04: start","job_status":"start","queue_duration_s":1.409993,"scheduling_latency_s":1.410023}1441vm-test-run-nixbot-gitlab> gitlab # [ 249.887025] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.508Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"9fab5703239dabaf0e4d9e04","created_at":"2026-09-14T09:32:05.066Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"71cd4445396c1ec33b78f21d6ba5739c","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.073Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-9fab5703239dabaf0e4d9e04: done: 0.024756 sec","job_status":"done","queue_duration_s":1.409993,"scheduling_latency_s":1.410023,"redis_calls":7,"redis_duration_s":0.00185,"redis_read_bytes":5,"redis_write_bytes":711,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00133,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00052,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012414,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024756,"completed_at":"2026-09-14T09:32:06.508Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.005611,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1442vm-test-run-nixbot-gitlab> gitlab # [ 249.927284] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.509Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2717d4187a1e29ca5865716d","created_at":"2026-09-14T09:32:05.088Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d524f3c11a030e313a0e85beafc7c694","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.101Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2717d4187a1e29ca5865716d: start","job_status":"start","queue_duration_s":1.408495,"scheduling_latency_s":1.408521}1443vm-test-run-nixbot-gitlab> gitlab # [ 249.941950] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.518Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1444vm-test-run-nixbot-gitlab> gitlab # [ 249.945308] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.525Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"2717d4187a1e29ca5865716d","created_at":"2026-09-14T09:32:05.088Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d524f3c11a030e313a0e85beafc7c694","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.101Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-2717d4187a1e29ca5865716d: done: 0.015257 sec","job_status":"done","queue_duration_s":1.408495,"scheduling_latency_s":1.408521,"redis_calls":7,"redis_duration_s":0.001657,"redis_read_bytes":5,"redis_write_bytes":826,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001214,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000443,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009363,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.015257,"completed_at":"2026-09-14T09:32:06.524Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1445vm-test-run-nixbot-gitlab> gitlab # [ 249.986658] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.526Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"a001d974fe5a63c00b2a796b","created_at":"2026-09-14T09:32:05.117Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3744baefb5f287fb8ab9e9a6ee8c660b","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.132Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-a001d974fe5a63c00b2a796b: start","job_status":"start","queue_duration_s":1.39412,"scheduling_latency_s":1.394143}1446vm-test-run-nixbot-gitlab> gitlab # [ 249.999837] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.547Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"GitlabPerformanceBarStatsWorker","jid":"a001d974fe5a63c00b2a796b","created_at":"2026-09-14T09:32:05.117Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"3744baefb5f287fb8ab9e9a6ee8c660b","meta.root_caller_id":"Cronjob","meta.feature_category":"observability","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:393c75c82e0c4ccb08a7f1ba676a44e17ea4991969dda9da33b08a8d5bf6f24b","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.132Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"GitlabPerformanceBarStatsWorker JID-a001d974fe5a63c00b2a796b: done: 0.020618 sec","job_status":"done","queue_duration_s":1.39412,"scheduling_latency_s":1.394143,"redis_calls":12,"redis_duration_s":0.002831,"redis_read_bytes":10,"redis_write_bytes":1174,"redis_cache_calls":2,"redis_cache_duration_s":0.000551,"redis_cache_read_bytes":1,"redis_cache_write_bytes":93,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000519,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":305,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00127,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":562,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000491,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":214,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011267,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00032754,"duration_s":0.020618,"completed_at":"2026-09-14T09:32:06.547Z","load_balancing_strategy":"primary","db_duration_s":0.000678,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1447vm-test-run-nixbot-gitlab> gitlab # [ 250.041622] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.548Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"f2448d7ddfd90ccaf95b7da7","created_at":"2026-09-14T09:32:05.148Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"a6ec4d5585e1cb52e94c88b7e305c770","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.164Z","job_size_bytes":3,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-f2448d7ddfd90ccaf95b7da7: start","job_status":"start","queue_duration_s":1.384214,"scheduling_latency_s":1.384236}1448vm-test-run-nixbot-gitlab> gitlab # [ 250.055288] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.568Z","retry":25,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":["1"],"class":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker","jid":"f2448d7ddfd90ccaf95b7da7","created_at":"2026-09-14T09:32:05.148Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.feature_category":"fleet_visibility","correlation_id":"a6ec4d5585e1cb52e94c88b7e305c770","worker_data_consistency":"delayed","worker_data_consistency_per_db":{"main":"delayed","ci":"delayed"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:f3066c5baf1b66987ee2154bc897f8592e7a97485c950408f900b17a65777f1b","size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.164Z","job_size_bytes":3,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ClickHouse::FinishedPipelinesSyncCronWorker JID-f2448d7ddfd90ccaf95b7da7: done: 0.01976 sec","job_status":"done","queue_duration_s":1.384214,"scheduling_latency_s":1.384236,"redis_calls":10,"redis_duration_s":0.002291,"redis_read_bytes":9,"redis_write_bytes":1203,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000563,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":337,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.001282,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":622,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000446,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":244,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010899,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00033318,"duration_s":0.01976,"completed_at":"2026-09-14T09:32:06.568Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000758,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1449vm-test-run-nixbot-gitlab> gitlab # [ 250.096761] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.570Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b5cf39fd89212f853368225e","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b5cf39fd89212f853368225e: start","job_status":"start","queue_duration_s":1.294955,"scheduling_latency_s":1.29498}1450vm-test-run-nixbot-gitlab> gitlab # [ 250.108775] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.601Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b5cf39fd89212f853368225e","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b5cf39fd89212f853368225e: done: 0.031317 sec","job_status":"done","queue_duration_s":1.294955,"scheduling_latency_s":1.29498,"redis_calls":13,"redis_duration_s":0.003112,"redis_read_bytes":12,"redis_write_bytes":1300,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.00048,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":289,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001117,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":395,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001515,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":616,"db_count":3,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.007,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.007,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.018882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0003232,"duration_s":0.031317,"completed_at":"2026-09-14T09:32:06.601Z","load_balancing_strategy":"primary","db_duration_s":0.005034,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1451vm-test-run-nixbot-gitlab> gitlab # [ 250.148189] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.603Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"15a5fafeeba4174e5b0e399a","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-15a5fafeeba4174e5b0e399a: start","job_status":"start","queue_duration_s":1.327812,"scheduling_latency_s":1.327832}1452vm-test-run-nixbot-gitlab> gitlab # [ 250.160212] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.621Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"15a5fafeeba4174e5b0e399a","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-15a5fafeeba4174e5b0e399a: done: 0.018971 sec","job_status":"done","queue_duration_s":1.327812,"scheduling_latency_s":1.327832,"redis_calls":10,"redis_duration_s":0.002247,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001312,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01249,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018971,"completed_at":"2026-09-14T09:32:06.621Z","load_balancing_strategy":"primary","db_duration_s":0.001289,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1453vm-test-run-nixbot-gitlab> gitlab # [ 250.199110] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.623Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e95786c5737be3b14167c019","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e95786c5737be3b14167c019: start","job_status":"start","queue_duration_s":1.348311,"scheduling_latency_s":1.348333}1454vm-test-run-nixbot-gitlab> gitlab # [ 250.211199] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e95786c5737be3b14167c019","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e95786c5737be3b14167c019: done: 0.019171 sec","job_status":"done","queue_duration_s":1.348311,"scheduling_latency_s":1.348333,"redis_calls":10,"redis_duration_s":0.00271,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001373,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001337,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012318,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019171,"completed_at":"2026-09-14T09:32:06.642Z","load_balancing_strategy":"primary","db_duration_s":0.001389,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1455vm-test-run-nixbot-gitlab> gitlab # [ 250.249314] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.643Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e1e5140d8b2681e0375dc95c","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e1e5140d8b2681e0375dc95c: start","job_status":"start","queue_duration_s":1.368801,"scheduling_latency_s":1.368818}1456vm-test-run-nixbot-gitlab> gitlab # [ 250.261062] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.661Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e1e5140d8b2681e0375dc95c","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e1e5140d8b2681e0375dc95c: done: 0.017964 sec","job_status":"done","queue_duration_s":1.368801,"scheduling_latency_s":1.368818,"redis_calls":10,"redis_duration_s":0.002309,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001424,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012223,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017964,"completed_at":"2026-09-14T09:32:06.661Z","load_balancing_strategy":"primary","db_duration_s":0.001414,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1457vm-test-run-nixbot-gitlab> gitlab # [ 250.298349] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"49800b6c219dc5f33ce5a4fd","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-49800b6c219dc5f33ce5a4fd: start","job_status":"start","queue_duration_s":1.388098,"scheduling_latency_s":1.388115}1458vm-test-run-nixbot-gitlab> gitlab # [ 250.310246] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"49800b6c219dc5f33ce5a4fd","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-49800b6c219dc5f33ce5a4fd: done: 0.017874 sec","job_status":"done","queue_duration_s":1.388098,"scheduling_latency_s":1.388115,"redis_calls":10,"redis_duration_s":0.002175,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000883,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001292,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017874,"completed_at":"2026-09-14T09:32:06.681Z","load_balancing_strategy":"primary","db_duration_s":0.001394,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1459vm-test-run-nixbot-gitlab> gitlab # [ 250.347237] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.682Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2b39286aecbdff0bb8388e30","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2b39286aecbdff0bb8388e30: start","job_status":"start","queue_duration_s":1.407313,"scheduling_latency_s":1.407329}1460vm-test-run-nixbot-gitlab> gitlab # [ 250.359311] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.700Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2b39286aecbdff0bb8388e30","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2b39286aecbdff0bb8388e30: done: 0.018287 sec","job_status":"done","queue_duration_s":1.407313,"scheduling_latency_s":1.407329,"redis_calls":10,"redis_duration_s":0.0022110000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00092,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001291,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012398,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018287,"completed_at":"2026-09-14T09:32:06.700Z","load_balancing_strategy":"primary","db_duration_s":0.001485,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1461vm-test-run-nixbot-gitlab> gitlab # [ 250.397822] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.702Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"98777c9b1ce95aaf2a4267f4","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-98777c9b1ce95aaf2a4267f4: start","job_status":"start","queue_duration_s":1.426974,"scheduling_latency_s":1.42699}1462vm-test-run-nixbot-gitlab> gitlab # [ 250.409802] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.719Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"98777c9b1ce95aaf2a4267f4","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-98777c9b1ce95aaf2a4267f4: done: 0.017834 sec","job_status":"done","queue_duration_s":1.426974,"scheduling_latency_s":1.42699,"redis_calls":10,"redis_duration_s":0.002208,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001319,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012189,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017834,"completed_at":"2026-09-14T09:32:06.719Z","load_balancing_strategy":"primary","db_duration_s":0.001407,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1463vm-test-run-nixbot-gitlab> gitlab # [ 250.447644] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.721Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3bc0c58f145236a8aef88b05","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3bc0c58f145236a8aef88b05: start","job_status":"start","queue_duration_s":1.44616,"scheduling_latency_s":1.446177}1464vm-test-run-nixbot-gitlab> gitlab # [ 250.459886] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3bc0c58f145236a8aef88b05","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3bc0c58f145236a8aef88b05: done: 0.01833 sec","job_status":"done","queue_duration_s":1.44616,"scheduling_latency_s":1.446177,"redis_calls":10,"redis_duration_s":0.002273,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001336,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012403,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01833,"completed_at":"2026-09-14T09:32:06.739Z","load_balancing_strategy":"primary","db_duration_s":0.001478,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1465vm-test-run-nixbot-gitlab> gitlab # [ 250.497491] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9612c558810213d7df4434f3","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9612c558810213d7df4434f3: start","job_status":"start","queue_duration_s":1.466079,"scheduling_latency_s":1.466095}1466vm-test-run-nixbot-gitlab> gitlab # [ 250.509509] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.758Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9612c558810213d7df4434f3","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9612c558810213d7df4434f3: done: 0.017483 sec","job_status":"done","queue_duration_s":1.466079,"scheduling_latency_s":1.466095,"redis_calls":10,"redis_duration_s":0.002129,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001253,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011939,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017483,"completed_at":"2026-09-14T09:32:06.758Z","load_balancing_strategy":"primary","db_duration_s":0.001281,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1467vm-test-run-nixbot-gitlab> gitlab # [ 250.547219] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.760Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e3a4db090798f6b24db9a9cd","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e3a4db090798f6b24db9a9cd: start","job_status":"start","queue_duration_s":1.484849,"scheduling_latency_s":1.484865}1468vm-test-run-nixbot-gitlab> gitlab # [ 250.559533] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e3a4db090798f6b24db9a9cd","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e3a4db090798f6b24db9a9cd: done: 0.018552 sec","job_status":"done","queue_duration_s":1.484849,"scheduling_latency_s":1.484865,"redis_calls":10,"redis_duration_s":0.002202,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000884,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001318,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012943,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018552,"completed_at":"2026-09-14T09:32:06.778Z","load_balancing_strategy":"primary","db_duration_s":0.001313,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1469vm-test-run-nixbot-gitlab> gitlab # [ 250.597457] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"26fddc5f068f49fc3af08b29","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-26fddc5f068f49fc3af08b29: start","job_status":"start","queue_duration_s":1.504709,"scheduling_latency_s":1.504726}1470vm-test-run-nixbot-gitlab> gitlab # [ 250.610960] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.797Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"26fddc5f068f49fc3af08b29","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-26fddc5f068f49fc3af08b29: done: 0.018075 sec","job_status":"done","queue_duration_s":1.504709,"scheduling_latency_s":1.504726,"redis_calls":10,"redis_duration_s":0.002141,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001271,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012057,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018075,"completed_at":"2026-09-14T09:32:06.797Z","load_balancing_strategy":"primary","db_duration_s":0.001283,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1471vm-test-run-nixbot-gitlab> gitlab # [ 250.649234] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1038723fbfd8caef7e1db318","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1038723fbfd8caef7e1db318: start","job_status":"start","queue_duration_s":1.524882,"scheduling_latency_s":1.524899}1472vm-test-run-nixbot-gitlab> gitlab # [ 250.661290] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.818Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1038723fbfd8caef7e1db318","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1038723fbfd8caef7e1db318: done: 0.018657 sec","job_status":"done","queue_duration_s":1.524882,"scheduling_latency_s":1.524899,"redis_calls":10,"redis_duration_s":0.00235,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001413,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012781,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018657,"completed_at":"2026-09-14T09:32:06.818Z","load_balancing_strategy":"primary","db_duration_s":0.001344,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1473vm-test-run-nixbot-gitlab> gitlab # [ 250.699125] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.820Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4bb83597d5647b1ff8340bd1","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4bb83597d5647b1ff8340bd1: start","job_status":"start","queue_duration_s":1.544912,"scheduling_latency_s":1.544928}1474vm-test-run-nixbot-gitlab> gitlab # [ 250.711362] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.838Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"4bb83597d5647b1ff8340bd1","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-4bb83597d5647b1ff8340bd1: done: 0.018624 sec","job_status":"done","queue_duration_s":1.544912,"scheduling_latency_s":1.544928,"redis_calls":10,"redis_duration_s":0.0021869999999999997,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001298,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012969,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018624,"completed_at":"2026-09-14T09:32:06.838Z","load_balancing_strategy":"primary","db_duration_s":0.001258,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1475vm-test-run-nixbot-gitlab> gitlab # [ 250.749397] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.840Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3d3c1012853eb595137d92ad","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3d3c1012853eb595137d92ad: start","job_status":"start","queue_duration_s":1.564843,"scheduling_latency_s":1.56486}1476vm-test-run-nixbot-gitlab> gitlab # [ 250.761415] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3d3c1012853eb595137d92ad","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3d3c1012853eb595137d92ad: done: 0.018447 sec","job_status":"done","queue_duration_s":1.564843,"scheduling_latency_s":1.56486,"redis_calls":10,"redis_duration_s":0.002206,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001305,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012579,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018447,"completed_at":"2026-09-14T09:32:06.858Z","load_balancing_strategy":"primary","db_duration_s":0.001292,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1477vm-test-run-nixbot-gitlab> gitlab # [ 250.799900] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f35f1528629777cc103be72b","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f35f1528629777cc103be72b: start","job_status":"start","queue_duration_s":1.584598,"scheduling_latency_s":1.584615}1478vm-test-run-nixbot-gitlab> gitlab # [ 250.813365] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.877Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f35f1528629777cc103be72b","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f35f1528629777cc103be72b: done: 0.017855 sec","job_status":"done","queue_duration_s":1.584598,"scheduling_latency_s":1.584615,"redis_calls":10,"redis_duration_s":0.00215,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001274,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017855,"completed_at":"2026-09-14T09:32:06.877Z","load_balancing_strategy":"primary","db_duration_s":0.001293,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1479vm-test-run-nixbot-gitlab> gitlab # [ 250.851213] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.878Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"888098cd1b3d6a2e27447c58","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-888098cd1b3d6a2e27447c58: start","job_status":"start","queue_duration_s":1.603766,"scheduling_latency_s":1.603781}1480vm-test-run-nixbot-gitlab> gitlab # [ 250.863546] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.896Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"888098cd1b3d6a2e27447c58","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-888098cd1b3d6a2e27447c58: done: 0.018072 sec","job_status":"done","queue_duration_s":1.603766,"scheduling_latency_s":1.603781,"redis_calls":10,"redis_duration_s":0.002303,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00099,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001313,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012425,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018072,"completed_at":"2026-09-14T09:32:06.896Z","load_balancing_strategy":"primary","db_duration_s":0.001271,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1481vm-test-run-nixbot-gitlab> gitlab # [ 250.901670] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.898Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"094f5ec3364016d9f25a7248","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-094f5ec3364016d9f25a7248: start","job_status":"start","queue_duration_s":1.623266,"scheduling_latency_s":1.623283}1482vm-test-run-nixbot-gitlab> gitlab # [ 250.913543] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"094f5ec3364016d9f25a7248","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-094f5ec3364016d9f25a7248: done: 0.017675 sec","job_status":"done","queue_duration_s":1.623266,"scheduling_latency_s":1.623283,"redis_calls":10,"redis_duration_s":0.002191,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001321,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011896,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017675,"completed_at":"2026-09-14T09:32:06.916Z","load_balancing_strategy":"primary","db_duration_s":0.00124,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1483vm-test-run-nixbot-gitlab> gitlab # [ 250.951744] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"96793ec7d46518700d50fe49","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-96793ec7d46518700d50fe49: start","job_status":"start","queue_duration_s":1.642494,"scheduling_latency_s":1.64251}1484vm-test-run-nixbot-gitlab> gitlab # [ 250.964062] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.935Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"96793ec7d46518700d50fe49","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-96793ec7d46518700d50fe49: done: 0.017588 sec","job_status":"done","queue_duration_s":1.642494,"scheduling_latency_s":1.64251,"redis_calls":10,"redis_duration_s":0.00216,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000901,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001259,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012108,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017588,"completed_at":"2026-09-14T09:32:06.935Z","load_balancing_strategy":"primary","db_duration_s":0.001267,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1485vm-test-run-nixbot-gitlab> gitlab # [ 251.002406] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.936Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d9cf106adcb2ef2f235a741d","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d9cf106adcb2ef2f235a741d: start","job_status":"start","queue_duration_s":1.661379,"scheduling_latency_s":1.661395}1486vm-test-run-nixbot-gitlab> gitlab # [ 251.016119] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.954Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d9cf106adcb2ef2f235a741d","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d9cf106adcb2ef2f235a741d: done: 0.018286 sec","job_status":"done","queue_duration_s":1.661379,"scheduling_latency_s":1.661395,"redis_calls":10,"redis_duration_s":0.002588,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001266,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001322,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012321,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018286,"completed_at":"2026-09-14T09:32:06.954Z","load_balancing_strategy":"primary","db_duration_s":0.001257,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1487vm-test-run-nixbot-gitlab> gitlab # [ 251.053534] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.956Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"793487ecb57985f138b06055","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-793487ecb57985f138b06055: start","job_status":"start","queue_duration_s":1.680991,"scheduling_latency_s":1.681007}1488vm-test-run-nixbot-gitlab> gitlab # [ 251.065524] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"793487ecb57985f138b06055","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-793487ecb57985f138b06055: done: 0.018489 sec","job_status":"done","queue_duration_s":1.680991,"scheduling_latency_s":1.681007,"redis_calls":10,"redis_duration_s":0.002221,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000952,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001269,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012045,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018489,"completed_at":"2026-09-14T09:32:06.974Z","load_balancing_strategy":"primary","db_duration_s":0.001255,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1489vm-test-run-nixbot-gitlab> gitlab # [ 251.103443] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b4587018a501b3ec930d632b","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b4587018a501b3ec930d632b: start","job_status":"start","queue_duration_s":1.700802,"scheduling_latency_s":1.700818}1490vm-test-run-nixbot-gitlab> gitlab # [ 251.115336] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.994Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b4587018a501b3ec930d632b","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b4587018a501b3ec930d632b: done: 0.018235 sec","job_status":"done","queue_duration_s":1.700802,"scheduling_latency_s":1.700818,"redis_calls":10,"redis_duration_s":0.00214,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000875,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001265,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012594,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018235,"completed_at":"2026-09-14T09:32:06.994Z","load_balancing_strategy":"primary","db_duration_s":0.00148,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1491vm-test-run-nixbot-gitlab> gitlab # [ 251.152966] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:06.995Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2d68eb4647d95f847aba8419","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2d68eb4647d95f847aba8419: start","job_status":"start","queue_duration_s":1.720398,"scheduling_latency_s":1.720414}1492vm-test-run-nixbot-gitlab> gitlab # [ 251.164895] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.014Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"2d68eb4647d95f847aba8419","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-2d68eb4647d95f847aba8419: done: 0.018773 sec","job_status":"done","queue_duration_s":1.720398,"scheduling_latency_s":1.720414,"redis_calls":10,"redis_duration_s":0.002205,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000892,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001313,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018773,"completed_at":"2026-09-14T09:32:07.014Z","load_balancing_strategy":"primary","db_duration_s":0.001307,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1493vm-test-run-nixbot-gitlab> gitlab # [ 251.202295] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.015Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d60e2b0a7eea0a4add2f998b","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d60e2b0a7eea0a4add2f998b: start","job_status":"start","queue_duration_s":1.740447,"scheduling_latency_s":1.740464}1494vm-test-run-nixbot-gitlab> gitlab # [ 251.215399] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"d60e2b0a7eea0a4add2f998b","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-d60e2b0a7eea0a4add2f998b: done: 0.017985 sec","job_status":"done","queue_duration_s":1.740447,"scheduling_latency_s":1.740464,"redis_calls":10,"redis_duration_s":0.00229,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000932,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001358,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012218,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017985,"completed_at":"2026-09-14T09:32:07.033Z","load_balancing_strategy":"primary","db_duration_s":0.001277,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1495vm-test-run-nixbot-gitlab> gitlab # [ 251.252923] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"24f9000528cff3f9493c1f73","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-24f9000528cff3f9493c1f73: start","job_status":"start","queue_duration_s":1.759778,"scheduling_latency_s":1.759794}1496vm-test-run-nixbot-gitlab> gitlab # [ 251.264666] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.052Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"24f9000528cff3f9493c1f73","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-24f9000528cff3f9493c1f73: done: 0.017827 sec","job_status":"done","queue_duration_s":1.759778,"scheduling_latency_s":1.759794,"redis_calls":10,"redis_duration_s":0.002234,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000925,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001309,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01224,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017827,"completed_at":"2026-09-14T09:32:07.052Z","load_balancing_strategy":"primary","db_duration_s":0.001358,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1497vm-test-run-nixbot-gitlab> gitlab # [ 251.302384] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.054Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7c84047082f2706dcb71d2d6","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7c84047082f2706dcb71d2d6: start","job_status":"start","queue_duration_s":1.778972,"scheduling_latency_s":1.778989}1498vm-test-run-nixbot-gitlab> gitlab # [ 251.314432] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.071Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7c84047082f2706dcb71d2d6","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7c84047082f2706dcb71d2d6: done: 0.01775 sec","job_status":"done","queue_duration_s":1.778972,"scheduling_latency_s":1.778989,"redis_calls":10,"redis_duration_s":0.00221,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00133,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012243,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01775,"completed_at":"2026-09-14T09:32:07.071Z","load_balancing_strategy":"primary","db_duration_s":0.001259,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1499vm-test-run-nixbot-gitlab> gitlab # [ 251.351758] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.073Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a96a7f4941dc3272b3d72450","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a96a7f4941dc3272b3d72450: start","job_status":"start","queue_duration_s":1.79806,"scheduling_latency_s":1.798076}1500vm-test-run-nixbot-gitlab> gitlab # [ 251.364292] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.091Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"a96a7f4941dc3272b3d72450","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-a96a7f4941dc3272b3d72450: done: 0.01833 sec","job_status":"done","queue_duration_s":1.79806,"scheduling_latency_s":1.798076,"redis_calls":10,"redis_duration_s":0.002339,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000987,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001352,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01833,"completed_at":"2026-09-14T09:32:07.091Z","load_balancing_strategy":"primary","db_duration_s":0.0013,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1501vm-test-run-nixbot-gitlab> gitlab # [ 251.402332] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.092Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b26110404ffa4898fcc671c3","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b26110404ffa4898fcc671c3: start","job_status":"start","queue_duration_s":1.817694,"scheduling_latency_s":1.817711}1502vm-test-run-nixbot-gitlab> gitlab # [ 251.415412] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"b26110404ffa4898fcc671c3","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-b26110404ffa4898fcc671c3: done: 0.017553 sec","job_status":"done","queue_duration_s":1.817694,"scheduling_latency_s":1.817711,"redis_calls":10,"redis_duration_s":0.002119,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00087,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001249,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017553,"completed_at":"2026-09-14T09:32:07.110Z","load_balancing_strategy":"primary","db_duration_s":0.001237,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1503vm-test-run-nixbot-gitlab> gitlab # [ 251.453320] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.111Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3c695806039c02cc150038c0","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3c695806039c02cc150038c0: start","job_status":"start","queue_duration_s":1.836571,"scheduling_latency_s":1.836588}1504vm-test-run-nixbot-gitlab> gitlab # [ 251.465449] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.129Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"3c695806039c02cc150038c0","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-3c695806039c02cc150038c0: done: 0.017802 sec","job_status":"done","queue_duration_s":1.836571,"scheduling_latency_s":1.836588,"redis_calls":10,"redis_duration_s":0.002143,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00088,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001263,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012008,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017802,"completed_at":"2026-09-14T09:32:07.129Z","load_balancing_strategy":"primary","db_duration_s":0.001238,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1505vm-test-run-nixbot-gitlab> gitlab # [ 251.503723] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.130Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e01bd2205770f1fd968e017b","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e01bd2205770f1fd968e017b: start","job_status":"start","queue_duration_s":1.855679,"scheduling_latency_s":1.855696}1506vm-test-run-nixbot-gitlab> gitlab # [ 251.516023] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.148Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e01bd2205770f1fd968e017b","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e01bd2205770f1fd968e017b: done: 0.018006 sec","job_status":"done","queue_duration_s":1.855679,"scheduling_latency_s":1.855696,"redis_calls":10,"redis_duration_s":0.002608,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000942,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001666,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012106,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018006,"completed_at":"2026-09-14T09:32:07.148Z","load_balancing_strategy":"primary","db_duration_s":0.001199,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1507vm-test-run-nixbot-gitlab> gitlab # [ 251.553970] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.150Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"422ef7b88eec4561759ba601","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-422ef7b88eec4561759ba601: start","job_status":"start","queue_duration_s":1.875065,"scheduling_latency_s":1.875081}1508vm-test-run-nixbot-gitlab> gitlab # [ 251.566517] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.168Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"422ef7b88eec4561759ba601","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-422ef7b88eec4561759ba601: done: 0.01851 sec","job_status":"done","queue_duration_s":1.875065,"scheduling_latency_s":1.875081,"redis_calls":10,"redis_duration_s":0.002348,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000971,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001377,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012904,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01851,"completed_at":"2026-09-14T09:32:07.168Z","load_balancing_strategy":"primary","db_duration_s":0.001337,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1509vm-test-run-nixbot-gitlab> gitlab # [ 251.604631] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"74ed374fdd5695571b39c09f","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-74ed374fdd5695571b39c09f: start","job_status":"start","queue_duration_s":1.894987,"scheduling_latency_s":1.895004}1510vm-test-run-nixbot-gitlab> gitlab # [ 251.617714] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"74ed374fdd5695571b39c09f","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-74ed374fdd5695571b39c09f: done: 0.017624 sec","job_status":"done","queue_duration_s":1.894987,"scheduling_latency_s":1.895004,"redis_calls":10,"redis_duration_s":0.002199,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.00131,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012159,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017624,"completed_at":"2026-09-14T09:32:07.187Z","load_balancing_strategy":"primary","db_duration_s":0.001183,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1511vm-test-run-nixbot-gitlab> gitlab # [ 251.655680] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.189Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e376691cb6b405e77291e20c","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e376691cb6b405e77291e20c: start","job_status":"start","queue_duration_s":1.913932,"scheduling_latency_s":1.913949}1512vm-test-run-nixbot-gitlab> gitlab # [ 251.667831] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.207Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"e376691cb6b405e77291e20c","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-e376691cb6b405e77291e20c: done: 0.017963 sec","job_status":"done","queue_duration_s":1.913932,"scheduling_latency_s":1.913949,"redis_calls":10,"redis_duration_s":0.0021390000000000003,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000877,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001262,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012397,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017963,"completed_at":"2026-09-14T09:32:07.207Z","load_balancing_strategy":"primary","db_duration_s":0.001194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1513vm-test-run-nixbot-gitlab> gitlab # [ 251.706169] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.208Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6deb3bff3d8a286a5bdbe595","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6deb3bff3d8a286a5bdbe595: start","job_status":"start","queue_duration_s":1.93323,"scheduling_latency_s":1.933246}1514vm-test-run-nixbot-gitlab> gitlab # [ 251.718217] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"6deb3bff3d8a286a5bdbe595","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-6deb3bff3d8a286a5bdbe595: done: 0.017927 sec","job_status":"done","queue_duration_s":1.93323,"scheduling_latency_s":1.933246,"redis_calls":10,"redis_duration_s":0.00213,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000889,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001241,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011768,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017927,"completed_at":"2026-09-14T09:32:07.226Z","load_balancing_strategy":"primary","db_duration_s":0.001194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1515vm-test-run-nixbot-gitlab> gitlab # [ 251.755745] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.227Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"78b8803cf4f120b995ec9792","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-78b8803cf4f120b995ec9792: start","job_status":"start","queue_duration_s":1.952517,"scheduling_latency_s":1.952533}1516vm-test-run-nixbot-gitlab> gitlab # [ 251.768246] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.245Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"78b8803cf4f120b995ec9792","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-78b8803cf4f120b995ec9792: done: 0.017931 sec","job_status":"done","queue_duration_s":1.952517,"scheduling_latency_s":1.952533,"redis_calls":10,"redis_duration_s":0.002199,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000891,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001308,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012199,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017931,"completed_at":"2026-09-14T09:32:07.245Z","load_balancing_strategy":"primary","db_duration_s":0.001245,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1517vm-test-run-nixbot-gitlab> gitlab # [ 251.805296] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.246Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"16e199e838404614727b024b","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-16e199e838404614727b024b: start","job_status":"start","queue_duration_s":1.971777,"scheduling_latency_s":1.971793}1518vm-test-run-nixbot-gitlab> gitlab # [ 251.817176] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"16e199e838404614727b024b","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-16e199e838404614727b024b: done: 0.017585 sec","job_status":"done","queue_duration_s":1.971777,"scheduling_latency_s":1.971793,"redis_calls":10,"redis_duration_s":0.002154,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000885,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001269,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01214,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017585,"completed_at":"2026-09-14T09:32:07.264Z","load_balancing_strategy":"primary","db_duration_s":0.001227,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1519vm-test-run-nixbot-gitlab> gitlab # [ 251.855442] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.266Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"240be272758585540026a42e","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-240be272758585540026a42e: start","job_status":"start","queue_duration_s":1.991018,"scheduling_latency_s":1.991036}1520vm-test-run-nixbot-gitlab> gitlab # [ 251.867393] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.283Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"240be272758585540026a42e","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-240be272758585540026a42e: done: 0.017547 sec","job_status":"done","queue_duration_s":1.991018,"scheduling_latency_s":1.991036,"redis_calls":10,"redis_duration_s":0.00218,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000876,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001304,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012059,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017547,"completed_at":"2026-09-14T09:32:07.283Z","load_balancing_strategy":"primary","db_duration_s":0.001195,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1521vm-test-run-nixbot-gitlab> gitlab # [ 251.905151] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.285Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1517199b3f044d13e88d7c18","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1517199b3f044d13e88d7c18: start","job_status":"start","queue_duration_s":2.009872,"scheduling_latency_s":2.009888}1522vm-test-run-nixbot-gitlab> gitlab # [ 251.917159] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.303Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1517199b3f044d13e88d7c18","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1517199b3f044d13e88d7c18: done: 0.018299 sec","job_status":"done","queue_duration_s":2.009872,"scheduling_latency_s":2.009888,"redis_calls":10,"redis_duration_s":0.002212,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000937,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001275,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018299,"completed_at":"2026-09-14T09:32:07.303Z","load_balancing_strategy":"primary","db_duration_s":0.001192,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1523vm-test-run-nixbot-gitlab> gitlab # [ 251.954382] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.304Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"36be07ce8fbc85c5e8b86b80","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-36be07ce8fbc85c5e8b86b80: start","job_status":"start","queue_duration_s":2.029482,"scheduling_latency_s":2.029498}1524vm-test-run-nixbot-gitlab> gitlab # [ 251.966425] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.322Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"36be07ce8fbc85c5e8b86b80","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-36be07ce8fbc85c5e8b86b80: done: 0.017697 sec","job_status":"done","queue_duration_s":2.029482,"scheduling_latency_s":2.029498,"redis_calls":10,"redis_duration_s":0.002143,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000899,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001244,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011816,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017697,"completed_at":"2026-09-14T09:32:07.322Z","load_balancing_strategy":"primary","db_duration_s":0.001194,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1525vm-test-run-nixbot-gitlab> gitlab # [ 252.003477] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.323Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f429a2645c61ad01bca198d1","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f429a2645c61ad01bca198d1: start","job_status":"start","queue_duration_s":2.048467,"scheduling_latency_s":2.048483}1526vm-test-run-nixbot-gitlab> gitlab # [ 252.015773] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"f429a2645c61ad01bca198d1","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-f429a2645c61ad01bca198d1: done: 0.017959 sec","job_status":"done","queue_duration_s":2.048467,"scheduling_latency_s":2.048483,"redis_calls":10,"redis_duration_s":0.002223,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000935,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001288,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012343,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017959,"completed_at":"2026-09-14T09:32:07.341Z","load_balancing_strategy":"primary","db_duration_s":0.001241,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1527vm-test-run-nixbot-gitlab> gitlab # [ 252.054743] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.343Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cca548dec84eedd35d792eac","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cca548dec84eedd35d792eac: start","job_status":"start","queue_duration_s":2.068498,"scheduling_latency_s":2.068516}1528vm-test-run-nixbot-gitlab> gitlab # [ 252.066749] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.362Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"cca548dec84eedd35d792eac","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-cca548dec84eedd35d792eac: done: 0.01923 sec","job_status":"done","queue_duration_s":2.068498,"scheduling_latency_s":2.068516,"redis_calls":10,"redis_duration_s":0.002173,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000887,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001286,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013593,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.01923,"completed_at":"2026-09-14T09:32:07.362Z","load_balancing_strategy":"primary","db_duration_s":0.001225,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1529vm-test-run-nixbot-gitlab> gitlab # [ 252.104136] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"97949fba590f499f2870d38d","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-97949fba590f499f2870d38d: start","job_status":"start","queue_duration_s":2.08978,"scheduling_latency_s":2.089798}1530vm-test-run-nixbot-gitlab> gitlab # [ 252.115964] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.385Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"97949fba590f499f2870d38d","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-97949fba590f499f2870d38d: done: 0.020306 sec","job_status":"done","queue_duration_s":2.08978,"scheduling_latency_s":2.089798,"redis_calls":10,"redis_duration_s":0.002739,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001451,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001288,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.002,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013818,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.020306,"completed_at":"2026-09-14T09:32:07.385Z","load_balancing_strategy":"primary","db_duration_s":0.002915,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1531vm-test-run-nixbot-gitlab> gitlab # [ 252.153721] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.387Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"59bd13298fb274b285cdcf16","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-59bd13298fb274b285cdcf16: start","job_status":"start","queue_duration_s":2.112432,"scheduling_latency_s":2.112449}1532vm-test-run-nixbot-gitlab> gitlab # [ 252.166124] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.407Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"59bd13298fb274b285cdcf16","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-59bd13298fb274b285cdcf16: done: 0.019648 sec","job_status":"done","queue_duration_s":2.112432,"scheduling_latency_s":2.112449,"redis_calls":10,"redis_duration_s":0.002141,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000852,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001289,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.002,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.002,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013567,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019648,"completed_at":"2026-09-14T09:32:07.407Z","load_balancing_strategy":"primary","db_duration_s":0.001287,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1533vm-test-run-nixbot-gitlab> gitlab # [ 252.203425] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9acd4e2f78ba0a5eb742d172","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9acd4e2f78ba0a5eb742d172: start","job_status":"start","queue_duration_s":2.133411,"scheduling_latency_s":2.133426}1534vm-test-run-nixbot-gitlab> gitlab # [ 252.215523] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.441Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"9acd4e2f78ba0a5eb742d172","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-9acd4e2f78ba0a5eb742d172: done: 0.032701 sec","job_status":"done","queue_duration_s":2.133411,"scheduling_latency_s":2.133426,"redis_calls":10,"redis_duration_s":0.002214,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000898,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001316,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.013094,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.032701,"completed_at":"2026-09-14T09:32:07.441Z","load_balancing_strategy":"primary","db_duration_s":0.001329,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1535vm-test-run-nixbot-gitlab> gitlab # [ 252.254582] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.442Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"676bc194207d0dbd5d5b28a9","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-676bc194207d0dbd5d5b28a9: start","job_status":"start","queue_duration_s":2.167592,"scheduling_latency_s":2.167609}1536vm-test-run-nixbot-gitlab> gitlab # [ 252.266426] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.461Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"676bc194207d0dbd5d5b28a9","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-676bc194207d0dbd5d5b28a9: done: 0.018796 sec","job_status":"done","queue_duration_s":2.167592,"scheduling_latency_s":2.167609,"redis_calls":10,"redis_duration_s":0.002149,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000692,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001457,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012691,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018796,"completed_at":"2026-09-14T09:32:07.461Z","load_balancing_strategy":"primary","db_duration_s":0.001551,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1537vm-test-run-nixbot-gitlab> gitlab # [ 252.303985] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.462Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8cc37c424c8cbde31db7f4f7","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8cc37c424c8cbde31db7f4f7: start","job_status":"start","queue_duration_s":2.187469,"scheduling_latency_s":2.187486}1538vm-test-run-nixbot-gitlab> gitlab # [ 252.315877] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.480Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"8cc37c424c8cbde31db7f4f7","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-8cc37c424c8cbde31db7f4f7: done: 0.017418 sec","job_status":"done","queue_duration_s":2.187469,"scheduling_latency_s":2.187486,"redis_calls":10,"redis_duration_s":0.001421,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000568,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000853,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01253,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017418,"completed_at":"2026-09-14T09:32:07.479Z","load_balancing_strategy":"primary","db_duration_s":0.001301,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1539vm-test-run-nixbot-gitlab> gitlab # [ 252.353580] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"743dd7359875f659ec6355b0","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-743dd7359875f659ec6355b0: start","job_status":"start","queue_duration_s":2.206056,"scheduling_latency_s":2.206074}1540vm-test-run-nixbot-gitlab> gitlab # [ 252.365574] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"743dd7359875f659ec6355b0","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-743dd7359875f659ec6355b0: done: 0.017162 sec","job_status":"done","queue_duration_s":2.206056,"scheduling_latency_s":2.206074,"redis_calls":10,"redis_duration_s":0.001325,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000771,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012275,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017162,"completed_at":"2026-09-14T09:32:07.498Z","load_balancing_strategy":"primary","db_duration_s":0.001321,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1541vm-test-run-nixbot-gitlab> gitlab # [ 252.403275] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1149467bfd2a6a5b5cd55f22","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1149467bfd2a6a5b5cd55f22: start","job_status":"start","queue_duration_s":2.22434,"scheduling_latency_s":2.224357}1542vm-test-run-nixbot-gitlab> gitlab # [ 252.415312] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.516Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"1149467bfd2a6a5b5cd55f22","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-1149467bfd2a6a5b5cd55f22: done: 0.017238 sec","job_status":"done","queue_duration_s":2.22434,"scheduling_latency_s":2.224357,"redis_calls":10,"redis_duration_s":0.001376,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000597,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000779,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012424,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017238,"completed_at":"2026-09-14T09:32:07.516Z","load_balancing_strategy":"primary","db_duration_s":0.001278,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1543vm-test-run-nixbot-gitlab> gitlab # [ 252.454328] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.517Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7bfd3d08d423e247f9b29534","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7bfd3d08d423e247f9b29534: start","job_status":"start","queue_duration_s":2.242716,"scheduling_latency_s":2.242734}1544vm-test-run-nixbot-gitlab> gitlab # [ 252.466389] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.535Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"7bfd3d08d423e247f9b29534","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-7bfd3d08d423e247f9b29534: done: 0.017583 sec","job_status":"done","queue_duration_s":2.242716,"scheduling_latency_s":2.242734,"redis_calls":10,"redis_duration_s":0.00147,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000602,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000868,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017583,"completed_at":"2026-09-14T09:32:07.535Z","load_balancing_strategy":"primary","db_duration_s":0.00129,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1545vm-test-run-nixbot-gitlab> gitlab # [ 252.503876] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.536Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"de068987578f37baf644336d","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-de068987578f37baf644336d: start","job_status":"start","queue_duration_s":2.261394,"scheduling_latency_s":2.261411}1546vm-test-run-nixbot-gitlab> gitlab # [ 252.516141] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.553Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"de068987578f37baf644336d","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-de068987578f37baf644336d: done: 0.017286 sec","job_status":"done","queue_duration_s":2.261394,"scheduling_latency_s":2.261411,"redis_calls":10,"redis_duration_s":0.001336,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000762,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012312,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017286,"completed_at":"2026-09-14T09:32:07.553Z","load_balancing_strategy":"primary","db_duration_s":0.00143,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1547vm-test-run-nixbot-gitlab> gitlab # [ 252.553453] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.554Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"076ac866a9e4b7f3eaee98b2","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-076ac866a9e4b7f3eaee98b2: start","job_status":"start","queue_duration_s":2.279797,"scheduling_latency_s":2.279815}1548vm-test-run-nixbot-gitlab> gitlab # [ 252.565486] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.572Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DeleteObjectsWorker","args":[],"jid":"076ac866a9e4b7f3eaee98b2","created_at":"2026-09-14T09:32:05.076Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-3f7fdd8476c946e9","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleDeleteObjectsCronWorker","correlation_id":"8d1fe7a518db517aaabdd2b31f4f43b7","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.275Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DeleteObjectsWorker JID-076ac866a9e4b7f3eaee98b2: done: 0.017325 sec","job_status":"done","queue_duration_s":2.279797,"scheduling_latency_s":2.279815,"redis_calls":10,"redis_duration_s":0.001351,"redis_read_bytes":8,"redis_write_bytes":942,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":326,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000797,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":616,"db_count":2,"db_write_count":1,"db_cached_count":0,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":1,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":2,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":1,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.001,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.001,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.001,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012568,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017325,"completed_at":"2026-09-14T09:32:07.572Z","load_balancing_strategy":"primary","db_duration_s":0.001233,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1549vm-test-run-nixbot-gitlab> gitlab # [ 252.603712] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.573Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"781c1e24ce313cfd429647a9","created_at":"2026-09-14T09:32:05.338Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-ee8423edc09e4690","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"29f9c0a9667f9427aad98b49373f780d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.349Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-781c1e24ce313cfd429647a9: start","job_status":"start","queue_duration_s":2.224225,"scheduling_latency_s":2.224244}1550vm-test-run-nixbot-gitlab> gitlab # [ 252.616033] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.583Z","message":"No existing merge request to be cleaned up."}1551vm-test-run-nixbot-gitlab> gitlab # [ 252.617631] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.592Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"781c1e24ce313cfd429647a9","created_at":"2026-09-14T09:32:05.338Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-ee8423edc09e4690","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"29f9c0a9667f9427aad98b49373f780d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.349Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-781c1e24ce313cfd429647a9: done: 0.018578 sec","job_status":"done","queue_duration_s":2.224225,"scheduling_latency_s":2.224244,"redis_calls":10,"redis_duration_s":0.001311,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000756,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.002,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.002,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012614,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.018578,"completed_at":"2026-09-14T09:32:07.591Z","load_balancing_strategy":"primary","db_duration_s":0.002484,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1552vm-test-run-nixbot-gitlab> gitlab # [ 252.656808] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.593Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"81e2c5606dd0e16282ceaf9e","created_at":"2026-09-14T09:32:05.338Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-ee8423edc09e4690","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"29f9c0a9667f9427aad98b49373f780d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.349Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-81e2c5606dd0e16282ceaf9e: start","job_status":"start","queue_duration_s":2.243968,"scheduling_latency_s":2.243986}1553vm-test-run-nixbot-gitlab> gitlab # [ 252.668926] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.603Z","message":"No existing merge request to be cleaned up."}1554vm-test-run-nixbot-gitlab> gitlab # [ 252.670581] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.610Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"81e2c5606dd0e16282ceaf9e","created_at":"2026-09-14T09:32:05.338Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-ee8423edc09e4690","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"29f9c0a9667f9427aad98b49373f780d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.349Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-81e2c5606dd0e16282ceaf9e: done: 0.017784 sec","job_status":"done","queue_duration_s":2.243968,"scheduling_latency_s":2.243986,"redis_calls":10,"redis_duration_s":0.001297,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00055,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000747,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012211,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017784,"completed_at":"2026-09-14T09:32:07.610Z","load_balancing_strategy":"primary","db_duration_s":0.002328,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1555vm-test-run-nixbot-gitlab> gitlab # [ 252.708781] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.612Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"42db73502c761e216a200182","created_at":"2026-09-14T09:32:05.338Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-ee8423edc09e4690","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"29f9c0a9667f9427aad98b49373f780d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.349Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-42db73502c761e216a200182: start","job_status":"start","queue_duration_s":2.262837,"scheduling_latency_s":2.262854}1556vm-test-run-nixbot-gitlab> gitlab # [ 252.720818] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.621Z","message":"No existing merge request to be cleaned up."}1557vm-test-run-nixbot-gitlab> gitlab # [ 252.722492] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.629Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"42db73502c761e216a200182","created_at":"2026-09-14T09:32:05.338Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-ee8423edc09e4690","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"29f9c0a9667f9427aad98b49373f780d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.349Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-42db73502c761e216a200182: done: 0.017355 sec","job_status":"done","queue_duration_s":2.262837,"scheduling_latency_s":2.262854,"redis_calls":10,"redis_duration_s":0.001304,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000749,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017355,"completed_at":"2026-09-14T09:32:07.629Z","load_balancing_strategy":"primary","db_duration_s":0.001842,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1558vm-test-run-nixbot-gitlab> gitlab # [ 252.760137] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.630Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5f6bfaa40c06a68584185ec0","created_at":"2026-09-14T09:32:05.338Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-ee8423edc09e4690","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"29f9c0a9667f9427aad98b49373f780d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.349Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5f6bfaa40c06a68584185ec0: start","job_status":"start","queue_duration_s":2.281303,"scheduling_latency_s":2.281321}1559vm-test-run-nixbot-gitlab> gitlab # [ 252.772117] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.640Z","message":"No existing merge request to be cleaned up."}1560vm-test-run-nixbot-gitlab> gitlab # [ 252.773727] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.647Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"5f6bfaa40c06a68584185ec0","created_at":"2026-09-14T09:32:05.338Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-ee8423edc09e4690","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"29f9c0a9667f9427aad98b49373f780d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:05.349Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-5f6bfaa40c06a68584185ec0: done: 0.017041 sec","job_status":"done","queue_duration_s":2.281303,"scheduling_latency_s":2.281321,"redis_calls":10,"redis_duration_s":0.001279,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000743,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011882,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017041,"completed_at":"2026-09-14T09:32:07.647Z","load_balancing_strategy":"primary","db_duration_s":0.001727,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1561vm-test-run-nixbot-gitlab> gitlab # [ 252.811453] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.648Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b3c98023466090d584d9201","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b3c98023466090d584d9201: start","job_status":"start","queue_duration_s":1.491343,"scheduling_latency_s":1.491361}1562vm-test-run-nixbot-gitlab> gitlab # [ 252.823910] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.662Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3b3c98023466090d584d9201","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3b3c98023466090d584d9201: done: 0.013935 sec","job_status":"done","queue_duration_s":1.491343,"scheduling_latency_s":1.491361,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000512,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009539,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013935,"completed_at":"2026-09-14T09:32:07.662Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1563vm-test-run-nixbot-gitlab> gitlab # [ 252.864269] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.663Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dee8c01e066ef646d72624bf","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dee8c01e066ef646d72624bf: start","job_status":"start","queue_duration_s":1.506377,"scheduling_latency_s":1.506395}1564vm-test-run-nixbot-gitlab> gitlab # [ 252.901067] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.679Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"dee8c01e066ef646d72624bf","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-dee8c01e066ef646d72624bf: done: 0.016076 sec","job_status":"done","queue_duration_s":1.506377,"scheduling_latency_s":1.506395,"redis_calls":13,"redis_duration_s":0.00149,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000982,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009658,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016076,"completed_at":"2026-09-14T09:32:07.679Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1565vm-test-run-nixbot-gitlab> gitlab # [ 252.971560] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.681Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fdd716d06b17fe0949a5220","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fdd716d06b17fe0949a5220: start","job_status":"start","queue_duration_s":1.523561,"scheduling_latency_s":1.523579}1566vm-test-run-nixbot-gitlab> gitlab # [ 252.986102] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.695Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6fdd716d06b17fe0949a5220","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6fdd716d06b17fe0949a5220: done: 0.013952 sec","job_status":"done","queue_duration_s":1.523561,"scheduling_latency_s":1.523579,"redis_calls":13,"redis_duration_s":0.00152,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00099,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009566,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013952,"completed_at":"2026-09-14T09:32:07.694Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1567vm-test-run-nixbot-gitlab> gitlab # [ 253.025494] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.696Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7579fef4aac9c661de0aa650","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7579fef4aac9c661de0aa650: start","job_status":"start","queue_duration_s":1.538659,"scheduling_latency_s":1.538677}1568vm-test-run-nixbot-gitlab> gitlab # [ 253.037676] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7579fef4aac9c661de0aa650","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7579fef4aac9c661de0aa650: done: 0.013658 sec","job_status":"done","queue_duration_s":1.538659,"scheduling_latency_s":1.538677,"redis_calls":13,"redis_duration_s":0.001422,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009334,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013658,"completed_at":"2026-09-14T09:32:07.709Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1569vm-test-run-nixbot-gitlab> gitlab # [ 253.077821] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.710Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baad21cc35fee83c7e0cce1a","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baad21cc35fee83c7e0cce1a: start","job_status":"start","queue_duration_s":1.553403,"scheduling_latency_s":1.55342}1570vm-test-run-nixbot-gitlab> gitlab # [ 253.090127] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"baad21cc35fee83c7e0cce1a","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-baad21cc35fee83c7e0cce1a: done: 0.013523 sec","job_status":"done","queue_duration_s":1.553403,"scheduling_latency_s":1.55342,"redis_calls":13,"redis_duration_s":0.00141,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009339,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013523,"completed_at":"2026-09-14T09:32:07.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1571vm-test-run-nixbot-gitlab> gitlab # [ 253.128451] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.725Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1f0436b5f34ef9b7721cf5","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1f0436b5f34ef9b7721cf5: start","job_status":"start","queue_duration_s":1.568085,"scheduling_latency_s":1.568102}1572vm-test-run-nixbot-gitlab> gitlab # [ 253.140678] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.739Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b1f0436b5f34ef9b7721cf5","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b1f0436b5f34ef9b7721cf5: done: 0.013496 sec","job_status":"done","queue_duration_s":1.568085,"scheduling_latency_s":1.568102,"redis_calls":13,"redis_duration_s":0.001392,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000494,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009356,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013496,"completed_at":"2026-09-14T09:32:07.739Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1573vm-test-run-nixbot-gitlab> gitlab # [ 253.179302] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6ea1ed44c3a450c34538fc9","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6ea1ed44c3a450c34538fc9: start","job_status":"start","queue_duration_s":1.582666,"scheduling_latency_s":1.582683}1574vm-test-run-nixbot-gitlab> gitlab # [ 253.191509] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.754Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d6ea1ed44c3a450c34538fc9","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d6ea1ed44c3a450c34538fc9: done: 0.01391 sec","job_status":"done","queue_duration_s":1.582666,"scheduling_latency_s":1.582683,"redis_calls":13,"redis_duration_s":0.0016350000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001118,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009457,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01391,"completed_at":"2026-09-14T09:32:07.754Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1575vm-test-run-nixbot-gitlab> gitlab # [ 253.230417] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.755Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e06a07da195799b8b04c014","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e06a07da195799b8b04c014: start","job_status":"start","queue_duration_s":1.597683,"scheduling_latency_s":1.5977}1576vm-test-run-nixbot-gitlab> gitlab # [ 253.242701] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.768Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8e06a07da195799b8b04c014","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8e06a07da195799b8b04c014: done: 0.013648 sec","job_status":"done","queue_duration_s":1.597683,"scheduling_latency_s":1.5977,"redis_calls":13,"redis_duration_s":0.00146,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000952,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009455,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013648,"completed_at":"2026-09-14T09:32:07.768Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1577vm-test-run-nixbot-gitlab> gitlab # [ 253.282369] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.770Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"985eb099f8c67b3d0e0cc03d","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-985eb099f8c67b3d0e0cc03d: start","job_status":"start","queue_duration_s":1.612479,"scheduling_latency_s":1.612495}1578vm-test-run-nixbot-gitlab> gitlab # [ 253.294491] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.783Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"985eb099f8c67b3d0e0cc03d","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-985eb099f8c67b3d0e0cc03d: done: 0.013658 sec","job_status":"done","queue_duration_s":1.612479,"scheduling_latency_s":1.612495,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000943,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009438,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013658,"completed_at":"2026-09-14T09:32:07.783Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1579vm-test-run-nixbot-gitlab> gitlab # [ 253.332994] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.785Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5452913770bd4ba240b42527","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5452913770bd4ba240b42527: start","job_status":"start","queue_duration_s":1.627586,"scheduling_latency_s":1.627669}1580vm-test-run-nixbot-gitlab> gitlab # [ 253.345138] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.798Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5452913770bd4ba240b42527","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5452913770bd4ba240b42527: done: 0.013743 sec","job_status":"done","queue_duration_s":1.627586,"scheduling_latency_s":1.627669,"redis_calls":13,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009401,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013743,"completed_at":"2026-09-14T09:32:07.798Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1581vm-test-run-nixbot-gitlab> gitlab # [ 253.383771] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.800Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8414a0103d3b8cec2f045d08","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8414a0103d3b8cec2f045d08: start","job_status":"start","queue_duration_s":1.64245,"scheduling_latency_s":1.642468}1582vm-test-run-nixbot-gitlab> gitlab # [ 253.396215] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.813Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8414a0103d3b8cec2f045d08","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8414a0103d3b8cec2f045d08: done: 0.013555 sec","job_status":"done","queue_duration_s":1.64245,"scheduling_latency_s":1.642468,"redis_calls":13,"redis_duration_s":0.0013930000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000888,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009361,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013555,"completed_at":"2026-09-14T09:32:07.813Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1583vm-test-run-nixbot-gitlab> gitlab # [ 253.434940] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.814Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b7dd21242570f10fed03929","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b7dd21242570f10fed03929: start","job_status":"start","queue_duration_s":1.657093,"scheduling_latency_s":1.65711}1584vm-test-run-nixbot-gitlab> gitlab # [ 253.447277] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7b7dd21242570f10fed03929","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7b7dd21242570f10fed03929: done: 0.01349 sec","job_status":"done","queue_duration_s":1.657093,"scheduling_latency_s":1.65711,"redis_calls":13,"redis_duration_s":0.0014130000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000506,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01349,"completed_at":"2026-09-14T09:32:07.828Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1585vm-test-run-nixbot-gitlab> gitlab # [ 253.487345] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.829Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cae9de8bca35f175777c7ed4","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cae9de8bca35f175777c7ed4: start","job_status":"start","queue_duration_s":1.671748,"scheduling_latency_s":1.671766}1586vm-test-run-nixbot-gitlab> gitlab # [ 253.499776] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cae9de8bca35f175777c7ed4","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cae9de8bca35f175777c7ed4: done: 0.013462 sec","job_status":"done","queue_duration_s":1.671748,"scheduling_latency_s":1.671766,"redis_calls":13,"redis_duration_s":0.001423,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013462,"completed_at":"2026-09-14T09:32:07.842Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1587vm-test-run-nixbot-gitlab> gitlab # [ 253.538682] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.843Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f66305d1288e793b998e53fe","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f66305d1288e793b998e53fe: start","job_status":"start","queue_duration_s":1.686364,"scheduling_latency_s":1.68638}1588vm-test-run-nixbot-gitlab> gitlab # [ 253.551115] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.858Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f66305d1288e793b998e53fe","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f66305d1288e793b998e53fe: done: 0.014135 sec","job_status":"done","queue_duration_s":1.686364,"scheduling_latency_s":1.68638,"redis_calls":13,"redis_duration_s":0.001677,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000746,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000931,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014135,"completed_at":"2026-09-14T09:32:07.857Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1589vm-test-run-nixbot-gitlab> gitlab # [ 253.589812] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7646fe24ca8d1ad38d26b61f","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7646fe24ca8d1ad38d26b61f: start","job_status":"start","queue_duration_s":1.70158,"scheduling_latency_s":1.701597}1590vm-test-run-nixbot-gitlab> gitlab # [ 253.601829] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.872Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7646fe24ca8d1ad38d26b61f","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7646fe24ca8d1ad38d26b61f: done: 0.013447 sec","job_status":"done","queue_duration_s":1.70158,"scheduling_latency_s":1.701597,"redis_calls":13,"redis_duration_s":0.001397,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009303,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013447,"completed_at":"2026-09-14T09:32:07.872Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1591vm-test-run-nixbot-gitlab> gitlab # [ 253.640501] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.873Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522df4ae1e0bccd8c1ef9c23","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522df4ae1e0bccd8c1ef9c23: start","job_status":"start","queue_duration_s":1.716124,"scheduling_latency_s":1.716141}1592vm-test-run-nixbot-gitlab> gitlab # [ 253.652810] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.887Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"522df4ae1e0bccd8c1ef9c23","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-522df4ae1e0bccd8c1ef9c23: done: 0.013468 sec","job_status":"done","queue_duration_s":1.716124,"scheduling_latency_s":1.716141,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000497,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000901,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009372,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013468,"completed_at":"2026-09-14T09:32:07.887Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1593vm-test-run-nixbot-gitlab> gitlab # [ 253.692547] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.888Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c81bd21fbfcf7e746fa2bc13","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c81bd21fbfcf7e746fa2bc13: start","job_status":"start","queue_duration_s":1.730693,"scheduling_latency_s":1.73071}1594vm-test-run-nixbot-gitlab> gitlab # [ 253.704786] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.901Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c81bd21fbfcf7e746fa2bc13","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c81bd21fbfcf7e746fa2bc13: done: 0.013516 sec","job_status":"done","queue_duration_s":1.730693,"scheduling_latency_s":1.73071,"redis_calls":13,"redis_duration_s":0.001388,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000881,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013516,"completed_at":"2026-09-14T09:32:07.901Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1595vm-test-run-nixbot-gitlab> gitlab # [ 253.743285] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.902Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d48e927ee3faa31ee29a8e5d","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d48e927ee3faa31ee29a8e5d: start","job_status":"start","queue_duration_s":1.745373,"scheduling_latency_s":1.74539}1596vm-test-run-nixbot-gitlab> gitlab # [ 253.755905] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.916Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d48e927ee3faa31ee29a8e5d","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d48e927ee3faa31ee29a8e5d: done: 0.013479 sec","job_status":"done","queue_duration_s":1.745373,"scheduling_latency_s":1.74539,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000505,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00934,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013479,"completed_at":"2026-09-14T09:32:07.916Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1597vm-test-run-nixbot-gitlab> gitlab # [ 253.794414] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.917Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30f4779fc2786f65db1df61f","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30f4779fc2786f65db1df61f: start","job_status":"start","queue_duration_s":1.759975,"scheduling_latency_s":1.759993}1598vm-test-run-nixbot-gitlab> gitlab # [ 253.806556] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.930Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"30f4779fc2786f65db1df61f","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-30f4779fc2786f65db1df61f: done: 0.013395 sec","job_status":"done","queue_duration_s":1.759975,"scheduling_latency_s":1.759993,"redis_calls":13,"redis_duration_s":0.001439,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000495,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009291,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013395,"completed_at":"2026-09-14T09:32:07.930Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1599vm-test-run-nixbot-gitlab> gitlab # [ 253.845315] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.932Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45a27fcf0a73930f0e457b55","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45a27fcf0a73930f0e457b55: start","job_status":"start","queue_duration_s":1.774453,"scheduling_latency_s":1.774469}1600vm-test-run-nixbot-gitlab> gitlab # [ 253.857775] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.945Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"45a27fcf0a73930f0e457b55","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-45a27fcf0a73930f0e457b55: done: 0.013768 sec","job_status":"done","queue_duration_s":1.774453,"scheduling_latency_s":1.774469,"redis_calls":13,"redis_duration_s":0.001424,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000518,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009404,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013768,"completed_at":"2026-09-14T09:32:07.945Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1601vm-test-run-nixbot-gitlab> gitlab # [ 253.897884] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.946Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21eeea3a1b6df91ad6a054a3","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21eeea3a1b6df91ad6a054a3: start","job_status":"start","queue_duration_s":1.789305,"scheduling_latency_s":1.789322}1602vm-test-run-nixbot-gitlab> gitlab # [ 253.910120] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.960Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"21eeea3a1b6df91ad6a054a3","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-21eeea3a1b6df91ad6a054a3: done: 0.013723 sec","job_status":"done","queue_duration_s":1.789305,"scheduling_latency_s":1.789322,"redis_calls":13,"redis_duration_s":0.001403,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000896,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009444,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013723,"completed_at":"2026-09-14T09:32:07.960Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1603vm-test-run-nixbot-gitlab> gitlab # [ 253.948607] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.961Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b144b4f538c0b85810d5f42d","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b144b4f538c0b85810d5f42d: start","job_status":"start","queue_duration_s":1.804159,"scheduling_latency_s":1.804176}1604vm-test-run-nixbot-gitlab> gitlab # [ 253.960945] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.975Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b144b4f538c0b85810d5f42d","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b144b4f538c0b85810d5f42d: done: 0.013337 sec","job_status":"done","queue_duration_s":1.804159,"scheduling_latency_s":1.804176,"redis_calls":13,"redis_duration_s":0.00138,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000488,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009237,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013337,"completed_at":"2026-09-14T09:32:07.974Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1605vm-test-run-nixbot-gitlab> gitlab # [ 253.999312] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.976Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b5d2cb2894310140d7bc0f0","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b5d2cb2894310140d7bc0f0: start","job_status":"start","queue_duration_s":1.818572,"scheduling_latency_s":1.81859}1606vm-test-run-nixbot-gitlab> gitlab # [ 254.011677] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4b5d2cb2894310140d7bc0f0","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4b5d2cb2894310140d7bc0f0: done: 0.01346 sec","job_status":"done","queue_duration_s":1.818572,"scheduling_latency_s":1.81859,"redis_calls":13,"redis_duration_s":0.001398,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009304,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01346,"completed_at":"2026-09-14T09:32:07.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1607vm-test-run-nixbot-gitlab> gitlab # [ 254.050937] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:07.990Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04702afb5e23457f80d9f4f1","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04702afb5e23457f80d9f4f1: start","job_status":"start","queue_duration_s":1.833119,"scheduling_latency_s":1.833136}1608vm-test-run-nixbot-gitlab> gitlab # [ 254.063358] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.004Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"04702afb5e23457f80d9f4f1","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-04702afb5e23457f80d9f4f1: done: 0.013483 sec","job_status":"done","queue_duration_s":1.833119,"scheduling_latency_s":1.833136,"redis_calls":13,"redis_duration_s":0.001392,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000892,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009412,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013483,"completed_at":"2026-09-14T09:32:08.004Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1609vm-test-run-nixbot-gitlab> gitlab # [ 254.103800] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.005Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c7a49522eae45d25f04bda7","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c7a49522eae45d25f04bda7: start","job_status":"start","queue_duration_s":1.847723,"scheduling_latency_s":1.84774}1610vm-test-run-nixbot-gitlab> gitlab # [ 254.140543] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.018Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2c7a49522eae45d25f04bda7","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2c7a49522eae45d25f04bda7: done: 0.013578 sec","job_status":"done","queue_duration_s":1.847723,"scheduling_latency_s":1.84774,"redis_calls":13,"redis_duration_s":0.001421,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009388,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013578,"completed_at":"2026-09-14T09:32:08.018Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1611vm-test-run-nixbot-gitlab> gitlab # [ 254.211020] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.019Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e93854c4b1f52ff1f9ed191a","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e93854c4b1f52ff1f9ed191a: start","job_status":"start","queue_duration_s":1.862439,"scheduling_latency_s":1.862456}1612vm-test-run-nixbot-gitlab> gitlab # [ 254.225347] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.033Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e93854c4b1f52ff1f9ed191a","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e93854c4b1f52ff1f9ed191a: done: 0.013467 sec","job_status":"done","queue_duration_s":1.862439,"scheduling_latency_s":1.862456,"redis_calls":13,"redis_duration_s":0.0013779999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000874,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009244,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013467,"completed_at":"2026-09-14T09:32:08.033Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1613vm-test-run-nixbot-gitlab> gitlab # [ 254.264075] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.034Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73ff49371cf92c2581a52e40","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73ff49371cf92c2581a52e40: start","job_status":"start","queue_duration_s":1.877023,"scheduling_latency_s":1.87704}1614vm-test-run-nixbot-gitlab> gitlab # [ 254.276111] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.048Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"73ff49371cf92c2581a52e40","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-73ff49371cf92c2581a52e40: done: 0.013517 sec","job_status":"done","queue_duration_s":1.877023,"scheduling_latency_s":1.87704,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013517,"completed_at":"2026-09-14T09:32:08.048Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1615vm-test-run-nixbot-gitlab> gitlab # [ 254.315113] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.049Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4468149799ea0865798fd13a","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4468149799ea0865798fd13a: start","job_status":"start","queue_duration_s":1.891667,"scheduling_latency_s":1.891684}1616vm-test-run-nixbot-gitlab> gitlab # [ 254.327408] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.062Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4468149799ea0865798fd13a","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4468149799ea0865798fd13a: done: 0.013683 sec","job_status":"done","queue_duration_s":1.891667,"scheduling_latency_s":1.891684,"redis_calls":13,"redis_duration_s":0.001396,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000491,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000905,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009301,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013683,"completed_at":"2026-09-14T09:32:08.062Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1617vm-test-run-nixbot-gitlab> gitlab # [ 254.365701] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.064Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c74237bde7db5ff50f7f7e1","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c74237bde7db5ff50f7f7e1: start","job_status":"start","queue_duration_s":1.906574,"scheduling_latency_s":1.906591}1618vm-test-run-nixbot-gitlab> gitlab # [ 254.377874] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.078Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6c74237bde7db5ff50f7f7e1","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6c74237bde7db5ff50f7f7e1: done: 0.01446 sec","job_status":"done","queue_duration_s":1.906574,"scheduling_latency_s":1.906591,"redis_calls":13,"redis_duration_s":0.00145,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000538,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.01002,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01446,"completed_at":"2026-09-14T09:32:08.078Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1619vm-test-run-nixbot-gitlab> gitlab # [ 254.415933] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.079Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67cac14b4771857c9d5950ce","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67cac14b4771857c9d5950ce: start","job_status":"start","queue_duration_s":1.922255,"scheduling_latency_s":1.922271}1620vm-test-run-nixbot-gitlab> gitlab # [ 254.428262] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.094Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"67cac14b4771857c9d5950ce","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-67cac14b4771857c9d5950ce: done: 0.014315 sec","job_status":"done","queue_duration_s":1.922255,"scheduling_latency_s":1.922271,"redis_calls":13,"redis_duration_s":0.0016359999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000716,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00092,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010009,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014315,"completed_at":"2026-09-14T09:32:08.094Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1621vm-test-run-nixbot-gitlab> gitlab # [ 254.467015] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.095Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6cf8032c6b72dd6e80f6dd8f","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6cf8032c6b72dd6e80f6dd8f: start","job_status":"start","queue_duration_s":1.937806,"scheduling_latency_s":1.937823}1622vm-test-run-nixbot-gitlab> gitlab # [ 254.479423] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.109Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6cf8032c6b72dd6e80f6dd8f","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6cf8032c6b72dd6e80f6dd8f: done: 0.01401 sec","job_status":"done","queue_duration_s":1.937806,"scheduling_latency_s":1.937823,"redis_calls":13,"redis_duration_s":0.001436,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000922,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009874,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01401,"completed_at":"2026-09-14T09:32:08.109Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1623vm-test-run-nixbot-gitlab> gitlab # [ 254.519068] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.110Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ac07c943037fc06de326669","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ac07c943037fc06de326669: start","job_status":"start","queue_duration_s":1.953074,"scheduling_latency_s":1.953092}1624vm-test-run-nixbot-gitlab> gitlab # [ 254.531421] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.124Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9ac07c943037fc06de326669","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9ac07c943037fc06de326669: done: 0.013984 sec","job_status":"done","queue_duration_s":1.953074,"scheduling_latency_s":1.953092,"redis_calls":13,"redis_duration_s":0.0014260000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000916,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009902,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013984,"completed_at":"2026-09-14T09:32:08.124Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1625vm-test-run-nixbot-gitlab> gitlab # [ 254.569874] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.125Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27ef3988052c0cf34c367a6a","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27ef3988052c0cf34c367a6a: start","job_status":"start","queue_duration_s":1.96817,"scheduling_latency_s":1.968188}1626vm-test-run-nixbot-gitlab> gitlab # [ 254.582189] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.139Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"27ef3988052c0cf34c367a6a","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-27ef3988052c0cf34c367a6a: done: 0.014038 sec","job_status":"done","queue_duration_s":1.96817,"scheduling_latency_s":1.968188,"redis_calls":13,"redis_duration_s":0.0014160000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009787,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014038,"completed_at":"2026-09-14T09:32:08.139Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1627vm-test-run-nixbot-gitlab> gitlab # [ 254.620806] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.140Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5efdfa0502d9c53457ea3956","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5efdfa0502d9c53457ea3956: start","job_status":"start","queue_duration_s":1.983363,"scheduling_latency_s":1.98338}1628vm-test-run-nixbot-gitlab> gitlab # [ 254.632936] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.155Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5efdfa0502d9c53457ea3956","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5efdfa0502d9c53457ea3956: done: 0.014402 sec","job_status":"done","queue_duration_s":1.983363,"scheduling_latency_s":1.98338,"redis_calls":13,"redis_duration_s":0.001628,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000694,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009924,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014402,"completed_at":"2026-09-14T09:32:08.155Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1629vm-test-run-nixbot-gitlab> gitlab # [ 254.671679] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.156Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fd4fbb0a3ab4487d04c3119","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fd4fbb0a3ab4487d04c3119: start","job_status":"start","queue_duration_s":1.998883,"scheduling_latency_s":1.998901}1630vm-test-run-nixbot-gitlab> gitlab # [ 254.684684] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.170Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fd4fbb0a3ab4487d04c3119","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fd4fbb0a3ab4487d04c3119: done: 0.014469 sec","job_status":"done","queue_duration_s":1.998883,"scheduling_latency_s":1.998901,"redis_calls":13,"redis_duration_s":0.001474,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000555,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009767,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014469,"completed_at":"2026-09-14T09:32:08.170Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1631vm-test-run-nixbot-gitlab> gitlab # [ 254.723917] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.171Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"789ebb79bec9d6595789382b","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-789ebb79bec9d6595789382b: start","job_status":"start","queue_duration_s":2.014386,"scheduling_latency_s":2.014403}1632vm-test-run-nixbot-gitlab> gitlab # [ 254.736148] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.186Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"789ebb79bec9d6595789382b","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-789ebb79bec9d6595789382b: done: 0.014165 sec","job_status":"done","queue_duration_s":2.014386,"scheduling_latency_s":2.014403,"redis_calls":13,"redis_duration_s":0.001419,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000511,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000908,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009621,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014165,"completed_at":"2026-09-14T09:32:08.186Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1633vm-test-run-nixbot-gitlab> gitlab # [ 254.774213] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.187Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd830495b91b72ff81ecf542","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd830495b91b72ff81ecf542: start","job_status":"start","queue_duration_s":2.029629,"scheduling_latency_s":2.029645}1634vm-test-run-nixbot-gitlab> gitlab # [ 254.786581] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.201Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cd830495b91b72ff81ecf542","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cd830495b91b72ff81ecf542: done: 0.014161 sec","job_status":"done","queue_duration_s":2.029629,"scheduling_latency_s":2.029645,"redis_calls":13,"redis_duration_s":0.001428,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000516,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009633,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014161,"completed_at":"2026-09-14T09:32:08.201Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1635vm-test-run-nixbot-gitlab> gitlab # [ 254.824679] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.202Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"517a5e569e3baf00ca4fdc2a","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-517a5e569e3baf00ca4fdc2a: start","job_status":"start","queue_duration_s":2.044838,"scheduling_latency_s":2.044855}1636vm-test-run-nixbot-gitlab> gitlab # [ 254.836805] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.216Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"517a5e569e3baf00ca4fdc2a","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-517a5e569e3baf00ca4fdc2a: done: 0.013994 sec","job_status":"done","queue_duration_s":2.044838,"scheduling_latency_s":2.044855,"redis_calls":13,"redis_duration_s":0.00143,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009736,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013994,"completed_at":"2026-09-14T09:32:08.216Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1637vm-test-run-nixbot-gitlab> gitlab # [ 254.875243] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.217Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db4dbf4a59a0ccdf325d1ffb","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db4dbf4a59a0ccdf325d1ffb: start","job_status":"start","queue_duration_s":2.060123,"scheduling_latency_s":2.06014}1638vm-test-run-nixbot-gitlab> gitlab # [ 254.913258] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.231Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db4dbf4a59a0ccdf325d1ffb","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db4dbf4a59a0ccdf325d1ffb: done: 0.01415 sec","job_status":"done","queue_duration_s":2.060123,"scheduling_latency_s":2.06014,"redis_calls":13,"redis_duration_s":0.0014650000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000554,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009863,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01415,"completed_at":"2026-09-14T09:32:08.231Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1639vm-test-run-nixbot-gitlab> gitlab # [ 254.988783] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.233Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77611abe186df1072d682c4d","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77611abe186df1072d682c4d: start","job_status":"start","queue_duration_s":2.075498,"scheduling_latency_s":2.075516}1640vm-test-run-nixbot-gitlab> gitlab # [ 255.025692] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.247Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"77611abe186df1072d682c4d","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-77611abe186df1072d682c4d: done: 0.014135 sec","job_status":"done","queue_duration_s":2.075498,"scheduling_latency_s":2.075516,"redis_calls":13,"redis_duration_s":0.0014529999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00094,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009979,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014135,"completed_at":"2026-09-14T09:32:08.247Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1641vm-test-run-nixbot-gitlab> gitlab # [ 255.096158] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.248Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d2f7ab046948e68899afcb2","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d2f7ab046948e68899afcb2: start","job_status":"start","queue_duration_s":2.090861,"scheduling_latency_s":2.090877}1642vm-test-run-nixbot-gitlab> gitlab # [ 255.110158] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.262Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"4d2f7ab046948e68899afcb2","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-4d2f7ab046948e68899afcb2: done: 0.014531 sec","job_status":"done","queue_duration_s":2.090861,"scheduling_latency_s":2.090877,"redis_calls":13,"redis_duration_s":0.001457,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000947,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010136,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014531,"completed_at":"2026-09-14T09:32:08.262Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1643vm-test-run-nixbot-gitlab> gitlab # [ 255.154487] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.264Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58e52fa14b8fe1fb3d3cc51f","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58e52fa14b8fe1fb3d3cc51f: start","job_status":"start","queue_duration_s":2.106649,"scheduling_latency_s":2.106668}1644vm-test-run-nixbot-gitlab> gitlab # [ 255.191300] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.278Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"58e52fa14b8fe1fb3d3cc51f","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-58e52fa14b8fe1fb3d3cc51f: done: 0.014264 sec","job_status":"done","queue_duration_s":2.106649,"scheduling_latency_s":2.106668,"redis_calls":13,"redis_duration_s":0.001445,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00052,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000925,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010023,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014264,"completed_at":"2026-09-14T09:32:08.278Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1645vm-test-run-nixbot-gitlab> gitlab # [ 255.260650] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.279Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"510cc29f4b8111e00ccceafc","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-510cc29f4b8111e00ccceafc: start","job_status":"start","queue_duration_s":2.122145,"scheduling_latency_s":2.122164}1646vm-test-run-nixbot-gitlab> gitlab # [ 255.274658] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.294Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"510cc29f4b8111e00ccceafc","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-510cc29f4b8111e00ccceafc: done: 0.014796 sec","job_status":"done","queue_duration_s":2.122145,"scheduling_latency_s":2.122164,"redis_calls":13,"redis_duration_s":0.001748,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000536,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001212,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010259,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014796,"completed_at":"2026-09-14T09:32:08.294Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1647vm-test-run-nixbot-gitlab> gitlab # [ 255.314897] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.295Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec8b0b95287fd75de332be9","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec8b0b95287fd75de332be9: start","job_status":"start","queue_duration_s":2.138027,"scheduling_latency_s":2.138045}1648vm-test-run-nixbot-gitlab> gitlab # [ 255.327213] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.309Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"eec8b0b95287fd75de332be9","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-eec8b0b95287fd75de332be9: done: 0.014234 sec","job_status":"done","queue_duration_s":2.138027,"scheduling_latency_s":2.138045,"redis_calls":13,"redis_duration_s":0.0015970000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00051,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001087,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009844,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014234,"completed_at":"2026-09-14T09:32:08.309Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1649vm-test-run-nixbot-gitlab> gitlab # [ 255.365552] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.310Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"102dd6413cd253aef7cff4b5","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-102dd6413cd253aef7cff4b5: start","job_status":"start","queue_duration_s":2.153334,"scheduling_latency_s":2.153351}1650vm-test-run-nixbot-gitlab> gitlab # [ 255.377710] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.325Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"102dd6413cd253aef7cff4b5","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-102dd6413cd253aef7cff4b5: done: 0.014181 sec","job_status":"done","queue_duration_s":2.153334,"scheduling_latency_s":2.153351,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009659,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014181,"completed_at":"2026-09-14T09:32:08.324Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1651vm-test-run-nixbot-gitlab> gitlab # [ 255.416322] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.326Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74a75eae6e19714269b04a11","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74a75eae6e19714269b04a11: start","job_status":"start","queue_duration_s":2.168638,"scheduling_latency_s":2.168656}1652vm-test-run-nixbot-gitlab> gitlab # [ 255.428226] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.340Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"74a75eae6e19714269b04a11","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-74a75eae6e19714269b04a11: done: 0.014288 sec","job_status":"done","queue_duration_s":2.168638,"scheduling_latency_s":2.168656,"redis_calls":13,"redis_duration_s":0.0016220000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001105,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009772,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014288,"completed_at":"2026-09-14T09:32:08.340Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1653vm-test-run-nixbot-gitlab> gitlab # [ 255.467384] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.341Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"768142b8581ce5a65dd99871","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-768142b8581ce5a65dd99871: start","job_status":"start","queue_duration_s":2.184006,"scheduling_latency_s":2.184023}1654vm-test-run-nixbot-gitlab> gitlab # [ 255.479851] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.356Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"768142b8581ce5a65dd99871","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-768142b8581ce5a65dd99871: done: 0.014815 sec","job_status":"done","queue_duration_s":2.184006,"scheduling_latency_s":2.184023,"redis_calls":13,"redis_duration_s":0.00163,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000552,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001078,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009852,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014815,"completed_at":"2026-09-14T09:32:08.356Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1655vm-test-run-nixbot-gitlab> gitlab # [ 255.518586] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.357Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46bcfe4a164bac17cf37d266","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46bcfe4a164bac17cf37d266: start","job_status":"start","queue_duration_s":2.19993,"scheduling_latency_s":2.199948}1656vm-test-run-nixbot-gitlab> gitlab # [ 255.531573] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.371Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"46bcfe4a164bac17cf37d266","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-46bcfe4a164bac17cf37d266: done: 0.01405 sec","job_status":"done","queue_duration_s":2.19993,"scheduling_latency_s":2.199948,"redis_calls":13,"redis_duration_s":0.001611,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000704,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000907,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009709,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01405,"completed_at":"2026-09-14T09:32:08.371Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1657vm-test-run-nixbot-gitlab> gitlab # [ 255.570569] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.372Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b914f79f52292c4f0ca9ab7","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b914f79f52292c4f0ca9ab7: start","job_status":"start","queue_duration_s":2.215175,"scheduling_latency_s":2.215191}1658vm-test-run-nixbot-gitlab> gitlab # [ 255.582718] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.386Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6b914f79f52292c4f0ca9ab7","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6b914f79f52292c4f0ca9ab7: done: 0.014166 sec","job_status":"done","queue_duration_s":2.215175,"scheduling_latency_s":2.215191,"redis_calls":13,"redis_duration_s":0.0014290000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000517,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009835,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014166,"completed_at":"2026-09-14T09:32:08.386Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1659vm-test-run-nixbot-gitlab> gitlab # [ 255.621599] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.388Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c64aae60bfb66554d657bf0b","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c64aae60bfb66554d657bf0b: start","job_status":"start","queue_duration_s":2.230687,"scheduling_latency_s":2.230705}1660vm-test-run-nixbot-gitlab> gitlab # [ 255.633703] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:32:08.402Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c64aae60bfb66554d657bf0b","created_at":"2026-09-14T09:32:06.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-389a3274a3ad4ee8","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"618192847aa30c45c64f6764d7faa42e","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:32:06.157Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c64aae60bfb66554d657bf0b: done: 0.014299 sec","job_status":"done","queue_duration_s":2.230687,"scheduling_latency_s":2.230705,"redis_calls":13,"redis_duration_s":0.001458,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000937,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010015,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014299,"completed_at":"2026-09-14T09:32:08.402Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1661vm-test-run-nixbot-gitlab> gitlab # [ 272.390449] setup-gitlab-start[2957]: W, [2026-09-14T09:32:29.226178 #2957] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.1662vm-test-run-nixbot-gitlab> gitlab # [ 307.580756] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:04.415Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"b3303ed9a1ffddb26651d809","created_at":"2026-09-14T09:33:04.317Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.409Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-b3303ed9a1ffddb26651d809: start","job_status":"start","queue_duration_s":0.006769,"scheduling_latency_s":0.006822}1663vm-test-run-nixbot-gitlab> gitlab # [ 308.211075] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.045Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleOldPipelinesRemovalCronWorker","jid":"b3303ed9a1ffddb26651d809","created_at":"2026-09-14T09:33:04.317Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:5cd05815835513d57d02434c59416c33dd1bebcfa3138e1542ab850c977747b0","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.409Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleOldPipelinesRemovalCronWorker JID-b3303ed9a1ffddb26651d809: done: 0.629551 sec","job_status":"done","queue_duration_s":0.006769,"scheduling_latency_s":0.006822,"redis_calls":35,"redis_duration_s":0.150184,"redis_read_bytes":932,"redis_write_bytes":11052,"redis_feature_flag_calls":11,"redis_feature_flag_duration_s":0.044972,"redis_feature_flag_read_bytes":900,"redis_feature_flag_write_bytes":1129,"redis_queues_calls":2,"redis_queues_duration_s":0.001735,"redis_queues_read_bytes":3,"redis_queues_write_bytes":8315,"redis_queues_metadata_calls":16,"redis_queues_metadata_duration_s":0.082849,"redis_queues_metadata_read_bytes":24,"redis_queues_metadata_write_bytes":1162,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.020628,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":446,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.067,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.067,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.152079,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.00166256,"duration_s":0.629551,"completed_at":"2026-09-14T09:33:05.045Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.11146,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1664vm-test-run-nixbot-gitlab> gitlab # [ 308.294859] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.096Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"381bed0406a76674131e9610","created_at":"2026-09-14T09:33:04.432Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c95b8d50995a0cd1ccbceac2090fec14","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.448Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-381bed0406a76674131e9610: start","job_status":"start","queue_duration_s":0.64786,"scheduling_latency_s":0.647915}1665vm-test-run-nixbot-gitlab> gitlab # [ 308.398763] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.234Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"BatchedGitRefUpdates::CleanupSchedulerWorker","jid":"381bed0406a76674131e9610","created_at":"2026-09-14T09:33:04.432Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c95b8d50995a0cd1ccbceac2090fec14","meta.root_caller_id":"Cronjob","meta.feature_category":"gitaly","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:1df286e3cb94a9fae913bbc935abcb74e2ce04a919d8b126d0730a03d3a1570c","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.448Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"BatchedGitRefUpdates::CleanupSchedulerWorker JID-381bed0406a76674131e9610: done: 0.138505 sec","job_status":"done","queue_duration_s":0.64786,"scheduling_latency_s":0.647915,"redis_calls":10,"redis_duration_s":0.053963,"redis_read_bytes":135,"redis_write_bytes":1184,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001438,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":97,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.007601,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":521,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.044924,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":566,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03359,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.04015456,"exclusive_lock_hold_duration_s":0.00859386,"extra.batched_git_ref_updates_cleanup_scheduler_worker.stats":{"total_projects":0},"duration_s":0.138505,"completed_at":"2026-09-14T09:33:05.234Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004048,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1666vm-test-run-nixbot-gitlab> gitlab # [ 308.482411] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.272Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2ce632eb074f761b0887f0a6","created_at":"2026-09-14T09:33:04.465Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"610f6ef4abca991b876e9b7d084d41f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.477Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2ce632eb074f761b0887f0a6: start","job_status":"start","queue_duration_s":0.794859,"scheduling_latency_s":0.79492}1667vm-test-run-nixbot-gitlab> gitlab # [ 308.498770] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.307Z","class":"Database::BackgroundOperation::SecSchedulerWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerWorker execution for unconfigured database sec","retry":0}1668vm-test-run-nixbot-gitlab> gitlab # [ 308.506086] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.342Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerWorker","jid":"2ce632eb074f761b0887f0a6","created_at":"2026-09-14T09:33:04.465Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"610f6ef4abca991b876e9b7d084d41f8","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:7bbb9537dbfe97e82719c1aa12366766ebff3829230f03761baf75912b8c8947","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.477Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerWorker JID-2ce632eb074f761b0887f0a6: done: 0.069309 sec","job_status":"done","queue_duration_s":0.794859,"scheduling_latency_s":0.79492,"redis_calls":8,"redis_duration_s":0.016509,"redis_read_bytes":133,"redis_write_bytes":873,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.001481,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":102,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.011362,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":527,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.003666,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":244,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028915,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.069309,"completed_at":"2026-09-14T09:33:05.341Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1669vm-test-run-nixbot-gitlab> gitlab # [ 308.551129] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.387Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"09dd06b5f64bac60e7745bdf","created_at":"2026-09-14T09:33:04.528Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9482d4cdefcdc08e837f1bbc69675f2a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.543Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-09dd06b5f64bac60e7745bdf: start","job_status":"start","queue_duration_s":0.843739,"scheduling_latency_s":0.843809}1670vm-test-run-nixbot-gitlab> gitlab # [ 308.918666] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.751Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker","jid":"09dd06b5f64bac60e7745bdf","created_at":"2026-09-14T09:33:04.528Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"9482d4cdefcdc08e837f1bbc69675f2a","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:10c3834637b4f27873c5f81cc6d8cb3cf1692f0fbee5628a0a3fe91dc0dcbc57","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.543Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::MergeRequestDiffCommitCleanupWorker JID-09dd06b5f64bac60e7745bdf: done: 0.363756 sec","job_status":"done","queue_duration_s":0.843739,"scheduling_latency_s":0.843809,"redis_calls":10,"redis_duration_s":0.107491,"redis_read_bytes":135,"redis_write_bytes":1275,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000615,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":106,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.003684,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":554,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.103192,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":615,"db_count":5,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":5,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.075,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":5,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.075,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.132025,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.10254848,"exclusive_lock_hold_duration_s":0.08142576,"extra.loose_foreign_keys_merge_request_diff_commit_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0},"duration_s":0.363756,"completed_at":"2026-09-14T09:33:05.751Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.098306,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1671vm-test-run-nixbot-gitlab> gitlab # [ 309.017883] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.757Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5dd6701b8c7cad56e967232d","created_at":"2026-09-14T09:33:04.582Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"482da2178e9164fd7faa683d0ae66cd7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T09:33:04.603Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5dd6701b8c7cad56e967232d: start","job_status":"start","queue_duration_s":1.153574,"scheduling_latency_s":1.153622}1672vm-test-run-nixbot-gitlab> gitlab # [ 309.039401] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.802Z","class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","database":"sec","message":"Skipping Database::BatchedBackgroundMigration::SecDatabaseWorker execution for unconfigured database sec","retry":0}1673vm-test-run-nixbot-gitlab> gitlab # [ 309.044274] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.819Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::SecDatabaseWorker","jid":"5dd6701b8c7cad56e967232d","created_at":"2026-09-14T09:33:04.582Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"482da2178e9164fd7faa683d0ae66cd7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:73dac367f8734ec768b767029c45c4e77750d97eb75e9dc81918dee7e9146dd0","enqueued_at":"2026-09-14T09:33:04.603Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::SecDatabaseWorker JID-5dd6701b8c7cad56e967232d: done: 0.061609 sec","job_status":"done","queue_duration_s":1.153574,"scheduling_latency_s":1.153622,"redis_calls":8,"redis_duration_s":0.005732,"redis_read_bytes":133,"redis_write_bytes":914,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000303,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":108,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002665,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":548,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.002764,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":258,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.038464,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061609,"completed_at":"2026-09-14T09:33:05.818Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1674vm-test-run-nixbot-gitlab> gitlab # [ 309.089705] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.822Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a4e84c6827f6e5add87b7c6e","created_at":"2026-09-14T09:33:04.632Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"936690beca649d037a5b771b1a3eda89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T09:33:04.655Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a4e84c6827f6e5add87b7c6e: start","job_status":"start","queue_duration_s":1.167642,"scheduling_latency_s":1.167707}1675vm-test-run-nixbot-gitlab> gitlab # [ 309.102811] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.884Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigrationWorker","jid":"a4e84c6827f6e5add87b7c6e","created_at":"2026-09-14T09:33:04.632Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"936690beca649d037a5b771b1a3eda89","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:592d9619e1997b640b70ce6a22f6713bc7793bb7a4e342b7380d90b691fcd6ae","enqueued_at":"2026-09-14T09:33:04.655Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigrationWorker JID-a4e84c6827f6e5add87b7c6e: done: 0.061981 sec","job_status":"done","queue_duration_s":1.167642,"scheduling_latency_s":1.167707,"redis_calls":9,"redis_duration_s":0.004131,"redis_read_bytes":261,"redis_write_bytes":906,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000606,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":165,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002577,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":509,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000948,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":232,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.007,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.007,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.042283,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.061981,"completed_at":"2026-09-14T09:33:05.884Z","load_balancing_strategy":"primary","db_duration_s":0.007444,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1676vm-test-run-nixbot-gitlab> gitlab # [ 309.144177] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:05.888Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"91ebee28f76c2ac18f273b08","created_at":"2026-09-14T09:33:04.685Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e22fd10d8b1d00a50c67a133a8eee28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.735Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-91ebee28f76c2ac18f273b08: start","job_status":"start","queue_duration_s":1.153074,"scheduling_latency_s":1.153151}1677vm-test-run-nixbot-gitlab> gitlab # [ 309.227603] redis[792]: 10 changes in 300 seconds. Saving...1678vm-test-run-nixbot-gitlab> gitlab # [ 309.230103] redis[792]: Background saving started by pid 32911679vm-test-run-nixbot-gitlab> gitlab # [ 309.242526] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.076Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"PipelineScheduleWorker","jid":"91ebee28f76c2ac18f273b08","created_at":"2026-09-14T09:33:04.685Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7e22fd10d8b1d00a50c67a133a8eee28","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:f6baa6e6d21754c4b13358fe49f8c31a08729a9dd276fb680a810caf1bc7fab5","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.735Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"PipelineScheduleWorker JID-91ebee28f76c2ac18f273b08: done: 0.188414 sec","job_status":"done","queue_duration_s":1.153074,"scheduling_latency_s":1.153151,"redis_calls":12,"redis_duration_s":0.015626,"redis_read_bytes":11,"redis_write_bytes":1281,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.008996,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":287,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.003636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":518,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.002994,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":476,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.017,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":1,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.016,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.121945,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00132228,"exclusive_lock_hold_duration_s":0.09641326,"duration_s":0.188414,"completed_at":"2026-09-14T09:33:06.076Z","load_balancing_strategy":"primary","db_duration_s":0.025361,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1680vm-test-run-nixbot-gitlab> gitlab # [ 309.311170] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.084Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8e62346da8c0efd41b4433da","created_at":"2026-09-14T09:33:04.775Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf7247c1f3a65f5cc5226f1e5f34f731","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.788Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8e62346da8c0efd41b4433da: start","job_status":"start","queue_duration_s":1.295522,"scheduling_latency_s":1.295619}1681vm-test-run-nixbot-gitlab> gitlab # [ 309.327912] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.139Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerCellLocalWorker","jid":"8e62346da8c0efd41b4433da","created_at":"2026-09-14T09:33:04.775Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"cf7247c1f3a65f5cc5226f1e5f34f731","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4ae89c58d1762b2d31a89d6fdeef88f3d5e03409467fbec711d482dc740c1b84","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.788Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerCellLocalWorker JID-8e62346da8c0efd41b4433da: done: 0.056046 sec","job_status":"done","queue_duration_s":1.295522,"scheduling_latency_s":1.295619,"redis_calls":9,"redis_duration_s":0.003804,"redis_read_bytes":261,"redis_write_bytes":1008,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000791,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":177,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.002095,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":563,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000918,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":268,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.03801,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.056046,"completed_at":"2026-09-14T09:33:06.139Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1682vm-test-run-nixbot-gitlab> gitlab # [ 309.370633] redis[3291]: BGSAVE done, 494 keys saved, 0 keys skipped, 131731 bytes written.1683vm-test-run-nixbot-gitlab> gitlab # [ 309.371974] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.143Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"8ef24cbed11356f02e1c64c4","created_at":"2026-09-14T09:33:04.830Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c188f609ee6952e9c33cb25d04345d9d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.850Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-8ef24cbed11356f02e1c64c4: start","job_status":"start","queue_duration_s":1.292916,"scheduling_latency_s":1.292977}1684vm-test-run-nixbot-gitlab> gitlab # [ 309.386380] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.181Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::MainSchedulerWorker","jid":"8ef24cbed11356f02e1c64c4","created_at":"2026-09-14T09:33:04.830Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c188f609ee6952e9c33cb25d04345d9d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:82a961bb8ace1086727bc80b4cde448c10530a6fb8b4c336ffe5d1d9d343271f","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.850Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::MainSchedulerWorker JID-8ef24cbed11356f02e1c64c4: done: 0.038672 sec","job_status":"done","queue_duration_s":1.292916,"scheduling_latency_s":1.292977,"redis_calls":8,"redis_duration_s":0.002381,"redis_read_bytes":133,"redis_write_bytes":879,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000262,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":103,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001529,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":530,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00059,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":246,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.02676,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038672,"completed_at":"2026-09-14T09:33:06.181Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1685vm-test-run-nixbot-gitlab> gitlab # [ 309.429344] redis[3291]: DB saved on disk1686vm-test-run-nixbot-gitlab> gitlab # [ 309.430119] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.184Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"34c43c3e541176bffec51f6b","created_at":"2026-09-14T09:33:04.917Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99a03af23e05a3c1c4d73e4071b5723b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.952Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-34c43c3e541176bffec51f6b: start","job_status":"start","queue_duration_s":1.232011,"scheduling_latency_s":1.232057}1687vm-test-run-nixbot-gitlab> gitlab # [ 309.443486] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.249Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ScheduleMergeRequestCleanupRefsWorker","jid":"34c43c3e541176bffec51f6b","created_at":"2026-09-14T09:33:04.917Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"99a03af23e05a3c1c4d73e4071b5723b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:33e8a9dcd4c9780ad0ea123ad7ccbabde1aa1e90ffcbb928434ba4b5800a5811","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.952Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ScheduleMergeRequestCleanupRefsWorker JID-34c43c3e541176bffec51f6b: done: 0.06514 sec","job_status":"done","queue_duration_s":1.232011,"scheduling_latency_s":1.232057,"redis_calls":16,"redis_duration_s":0.004673,"redis_read_bytes":272,"redis_write_bytes":4229,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000481,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":199,"redis_queues_calls":2,"redis_queues_duration_s":0.00061,"redis_queues_read_bytes":3,"redis_queues_write_bytes":3019,"redis_queues_metadata_calls":9,"redis_queues_metadata_duration_s":0.002727,"redis_queues_metadata_read_bytes":12,"redis_queues_metadata_write_bytes":727,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000855,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":284,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.051894,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.06514,"completed_at":"2026-09-14T09:33:06.249Z","load_balancing_strategy":"primary","db_duration_s":0.001522,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1688vm-test-run-nixbot-gitlab> gitlab # [ 309.485586] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.252Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3dda6feda53872e3c3ffb77b","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3dda6feda53872e3c3ffb77b: start","job_status":"start","queue_duration_s":1.277872,"scheduling_latency_s":1.277924}1689vm-test-run-nixbot-gitlab> gitlab # [ 309.498647] redis[3291]: Fork CoW for RDB: current 1 MB, peak 1 MB, average 0 MB1690vm-test-run-nixbot-gitlab> gitlab # [ 309.499798] redis[792]: Background saving terminated with success1691vm-test-run-nixbot-gitlab> gitlab # [ 309.542136] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.378Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"3dda6feda53872e3c3ffb77b","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-3dda6feda53872e3c3ffb77b: done: 0.125946 sec","job_status":"done","queue_duration_s":1.277872,"scheduling_latency_s":1.277924,"redis_calls":16,"redis_duration_s":0.005482,"redis_read_bytes":14,"redis_write_bytes":1526,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000638,"redis_feature_flag_read_bytes":2,"redis_feature_flag_write_bytes":301,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001773,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":423,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003071,"redis_shared_state_read_bytes":9,"redis_shared_state_write_bytes":802,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.012,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.012,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.08452,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0007189,"duration_s":0.125946,"completed_at":"2026-09-14T09:33:06.378Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.023696,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1692vm-test-run-nixbot-gitlab> gitlab # [ 309.584230] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.381Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a354309a51e4b931fdd3b0f0","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a354309a51e4b931fdd3b0f0: start","job_status":"start","queue_duration_s":1.406843,"scheduling_latency_s":1.406897}1693vm-test-run-nixbot-gitlab> gitlab # [ 309.597128] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.430Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a354309a51e4b931fdd3b0f0","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a354309a51e4b931fdd3b0f0: done: 0.048824 sec","job_status":"done","queue_duration_s":1.406843,"scheduling_latency_s":1.406897,"redis_calls":13,"redis_duration_s":0.0042,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001336,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002864,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.032909,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.048824,"completed_at":"2026-09-14T09:33:06.429Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002948,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1694vm-test-run-nixbot-gitlab> gitlab # [ 309.636981] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.433Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2b23ee732febe64b6624e0f7","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2b23ee732febe64b6624e0f7: start","job_status":"start","queue_duration_s":1.459124,"scheduling_latency_s":1.459175}1695vm-test-run-nixbot-gitlab> gitlab # [ 309.650138] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.478Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"2b23ee732febe64b6624e0f7","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-2b23ee732febe64b6624e0f7: done: 0.044629 sec","job_status":"done","queue_duration_s":1.459124,"scheduling_latency_s":1.459175,"redis_calls":13,"redis_duration_s":0.004106,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001227,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002879,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030831,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044629,"completed_at":"2026-09-14T09:33:06.478Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002095,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1696vm-test-run-nixbot-gitlab> gitlab # [ 309.689066] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.481Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a500542623e4a4e1a6db51e8","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a500542623e4a4e1a6db51e8: start","job_status":"start","queue_duration_s":1.506597,"scheduling_latency_s":1.506658}1697vm-test-run-nixbot-gitlab> gitlab # [ 309.702234] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.524Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"a500542623e4a4e1a6db51e8","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-a500542623e4a4e1a6db51e8: done: 0.043699 sec","job_status":"done","queue_duration_s":1.506597,"scheduling_latency_s":1.506658,"redis_calls":13,"redis_duration_s":0.004248,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001198,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00305,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.043699,"completed_at":"2026-09-14T09:33:06.524Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002111,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1698vm-test-run-nixbot-gitlab> gitlab # [ 309.741464] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.527Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"047d350398040815dfe2eb1e","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-047d350398040815dfe2eb1e: start","job_status":"start","queue_duration_s":1.553064,"scheduling_latency_s":1.553113}1699vm-test-run-nixbot-gitlab> gitlab # [ 309.754665] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.571Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"047d350398040815dfe2eb1e","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-047d350398040815dfe2eb1e: done: 0.044237 sec","job_status":"done","queue_duration_s":1.553064,"scheduling_latency_s":1.553113,"redis_calls":13,"redis_duration_s":0.004332,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001789,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002543,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.030006,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.044237,"completed_at":"2026-09-14T09:33:06.571Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002176,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1700vm-test-run-nixbot-gitlab> gitlab # [ 309.793502] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.574Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"e4b6aea1298ada82626b0f86","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-e4b6aea1298ada82626b0f86: start","job_status":"start","queue_duration_s":1.600245,"scheduling_latency_s":1.600295}1701vm-test-run-nixbot-gitlab> gitlab # [ 309.807152] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.615Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"e4b6aea1298ada82626b0f86","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-e4b6aea1298ada82626b0f86: done: 0.040603 sec","job_status":"done","queue_duration_s":1.600245,"scheduling_latency_s":1.600295,"redis_calls":13,"redis_duration_s":0.0035900000000000003,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001226,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002364,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.002,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.002,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.028048,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.040603,"completed_at":"2026-09-14T09:33:06.615Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001862,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1702vm-test-run-nixbot-gitlab> gitlab # [ 309.848120] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.617Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"793c651d44592912a8e5c0e8","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-793c651d44592912a8e5c0e8: start","job_status":"start","queue_duration_s":1.643458,"scheduling_latency_s":1.643482}1703vm-test-run-nixbot-gitlab> gitlab # [ 309.861203] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.656Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"793c651d44592912a8e5c0e8","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-793c651d44592912a8e5c0e8: done: 0.038606 sec","job_status":"done","queue_duration_s":1.643458,"scheduling_latency_s":1.643482,"redis_calls":13,"redis_duration_s":0.0037370000000000003,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001164,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002573,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026545,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.038606,"completed_at":"2026-09-14T09:33:06.656Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001196,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1704vm-test-run-nixbot-gitlab> gitlab # [ 309.901346] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"00081fdb48b50b433392ccce","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-00081fdb48b50b433392ccce: start","job_status":"start","queue_duration_s":1.685478,"scheduling_latency_s":1.685518}1705vm-test-run-nixbot-gitlab> gitlab # [ 309.914698] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.705Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"00081fdb48b50b433392ccce","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-00081fdb48b50b433392ccce: done: 0.045178 sec","job_status":"done","queue_duration_s":1.685478,"scheduling_latency_s":1.685518,"redis_calls":13,"redis_duration_s":0.004045,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001188,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002857,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033297,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.045178,"completed_at":"2026-09-14T09:33:06.704Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001315,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1706vm-test-run-nixbot-gitlab> gitlab # [ 309.954957] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.707Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4ff34305bcb25213899b59d5","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4ff34305bcb25213899b59d5: start","job_status":"start","queue_duration_s":1.733389,"scheduling_latency_s":1.733413}1707vm-test-run-nixbot-gitlab> gitlab # [ 309.968335] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.761Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"4ff34305bcb25213899b59d5","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-4ff34305bcb25213899b59d5: done: 0.053646 sec","job_status":"done","queue_duration_s":1.733389,"scheduling_latency_s":1.733413,"redis_calls":13,"redis_duration_s":0.004743,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.003176,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.031928,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.053646,"completed_at":"2026-09-14T09:33:06.761Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.001379,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1708vm-test-run-nixbot-gitlab> gitlab # [ 310.007917] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.765Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b279f2650072fcee0b17a753","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b279f2650072fcee0b17a753: start","job_status":"start","queue_duration_s":1.790827,"scheduling_latency_s":1.790871}1709vm-test-run-nixbot-gitlab> gitlab # [ 310.021466] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.804Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::DestroyOldPipelinesWorker","args":[],"jid":"b279f2650072fcee0b17a753","created_at":"2026-09-14T09:33:04.741Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-91f322957cf1493f","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleOldPipelinesRemovalCronWorker","correlation_id":"50a00c4fa9127831cb0c73970c88c77f","meta.root_caller_id":"Cronjob","meta.feature_category":"continuous_integration","meta.client_id":"ip/","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.974Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::DestroyOldPipelinesWorker JID-b279f2650072fcee0b17a753: done: 0.039869 sec","job_status":"done","queue_duration_s":1.790827,"scheduling_latency_s":1.790871,"redis_calls":13,"redis_duration_s":0.0034029999999999998,"redis_read_bytes":10,"redis_write_bytes":1149,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001119,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":347,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002284,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":802,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.026577,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.039869,"completed_at":"2026-09-14T09:33:06.804Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.000946,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1710vm-test-run-nixbot-gitlab> gitlab # [ 310.062109] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:06.807Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"41e1cc765a77f949ea935eba","created_at":"2026-09-14T09:33:04.976Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d12bf1dc4db009b44584e9c7f477aa8b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.990Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-41e1cc765a77f949ea935eba: start","job_status":"start","queue_duration_s":1.817668,"scheduling_latency_s":1.817689}1711vm-test-run-nixbot-gitlab> gitlab # [ 310.443761] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.279Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CleanupWorker","jid":"41e1cc765a77f949ea935eba","created_at":"2026-09-14T09:33:04.976Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"d12bf1dc4db009b44584e9c7f477aa8b","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:2180384c8554b410820afa81ad3479301139c7627524f882c6bca44488742df9","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:04.990Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CleanupWorker JID-41e1cc765a77f949ea935eba: done: 0.471471 sec","job_status":"done","queue_duration_s":1.817668,"scheduling_latency_s":1.817689,"redis_calls":11,"redis_duration_s":0.003764,"redis_read_bytes":263,"redis_write_bytes":1138,"redis_feature_flag_calls":2,"redis_feature_flag_duration_s":0.000579,"redis_feature_flag_read_bytes":256,"redis_feature_flag_write_bytes":151,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001636,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":476,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001549,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":511,"db_count":129,"db_write_count":0,"db_cached_count":84,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":129,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":84,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.066,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":129,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":84,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.066,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.379119,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0011878,"exclusive_lock_hold_duration_s":0.43467956,"extra.loose_foreign_keys_cleanup_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"connection":"ci","turbo_mode":false},"duration_s":0.471471,"completed_at":"2026-09-14T09:33:07.279Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.107697,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1712vm-test-run-nixbot-gitlab> gitlab # [ 310.532911] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.283Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"b117a704ded4cf5bc46d6648","created_at":"2026-09-14T09:33:05.033Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d0845d3207c4463089c5f1d92f348ab","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.039Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-b117a704ded4cf5bc46d6648: start","job_status":"start","queue_duration_s":2.243533,"scheduling_latency_s":2.243559}1713vm-test-run-nixbot-gitlab> gitlab # [ 310.887073] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.723Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"ConcurrencyLimit::ResumeWorker","jid":"b117a704ded4cf5bc46d6648","created_at":"2026-09-14T09:33:05.033Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"7d0845d3207c4463089c5f1d92f348ab","meta.root_caller_id":"Cronjob","meta.feature_category":"scalability","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bc8a9466f77693e94cb5ebf1ae9ff94995b6779d8794f59890276364c8a3c78a","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.039Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"ConcurrencyLimit::ResumeWorker JID-b117a704ded4cf5bc46d6648: done: 0.440342 sec","job_status":"done","queue_duration_s":2.243533,"scheduling_latency_s":2.243559,"redis_calls":563,"redis_duration_s":0.102701,"redis_read_bytes":688,"redis_write_bytes":48843,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000248,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001216,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":470,"redis_shared_state_calls":557,"redis_shared_state_duration_s":0.101237,"redis_shared_state_read_bytes":556,"redis_shared_state_write_bytes":48290,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.386786,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.440342,"completed_at":"2026-09-14T09:33:07.723Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1714vm-test-run-nixbot-gitlab> gitlab # [ 310.961115] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.725Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"3d4b2f9dbd0f54464d8deb57","created_at":"2026-09-14T09:33:05.053Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61a3a5b8a60e3b6dcc0024fee7c86559","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.059Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-3d4b2f9dbd0f54464d8deb57: start","job_status":"start","queue_duration_s":2.665638,"scheduling_latency_s":2.665671}1715vm-test-run-nixbot-gitlab> gitlab # [ 310.980070] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.734Z","class":"Database::BackgroundOperation::CiSchedulerWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerWorker execution for database that shares database configuration with another database","retry":0}1716vm-test-run-nixbot-gitlab> gitlab # [ 310.984492] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.740Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerWorker","jid":"3d4b2f9dbd0f54464d8deb57","created_at":"2026-09-14T09:33:05.053Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"61a3a5b8a60e3b6dcc0024fee7c86559","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:4b61026b1cc556e95b4252138194cc7290e8501b85e4e3c9de25155a8ef9d1ac","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.059Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerWorker JID-3d4b2f9dbd0f54464d8deb57: done: 0.014933 sec","job_status":"done","queue_duration_s":2.665638,"scheduling_latency_s":2.665671,"redis_calls":8,"redis_duration_s":0.001194,"redis_read_bytes":133,"redis_write_bytes":867,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000132,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":101,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.00074,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":524,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000322,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":242,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.014933,"completed_at":"2026-09-14T09:33:07.740Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1717vm-test-run-nixbot-gitlab> gitlab # [ 311.031341] postgres[860]: [860] LOG: checkpoint starting: time1718vm-test-run-nixbot-gitlab> gitlab # [ 311.032232] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.741Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bc5acce3aa6de993b47b5ab0","created_at":"2026-09-14T09:33:05.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a541974b085302ffbf3abf448d1beff7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T09:33:05.078Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bc5acce3aa6de993b47b5ab0: start","job_status":"start","queue_duration_s":2.663029,"scheduling_latency_s":2.663048}1719vm-test-run-nixbot-gitlab> gitlab # [ 311.045249] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.749Z","class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","database":"ci","message":"Skipping Database::BatchedBackgroundMigration::CiDatabaseWorker execution for database that shares database configuration with another database","retry":0}1720vm-test-run-nixbot-gitlab> gitlab # [ 311.048861] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.754Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BatchedBackgroundMigration::CiDatabaseWorker","jid":"bc5acce3aa6de993b47b5ab0","created_at":"2026-09-14T09:33:05.072Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a541974b085302ffbf3abf448d1beff7","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:6ba8adee4a8c1e77d2f087a2765c43226ceffa1fd65abc34b95725a7c9abd857","enqueued_at":"2026-09-14T09:33:05.078Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BatchedBackgroundMigration::CiDatabaseWorker JID-bc5acce3aa6de993b47b5ab0: done: 0.013169 sec","job_status":"done","queue_duration_s":2.663029,"scheduling_latency_s":2.663048,"redis_calls":8,"redis_duration_s":0.001069,"redis_read_bytes":133,"redis_write_bytes":908,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000116,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":107,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000677,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":545,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000276,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":256,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008661,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013169,"completed_at":"2026-09-14T09:33:07.754Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1721vm-test-run-nixbot-gitlab> gitlab # [ 311.090625] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.755Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7a877ac94581265589a42554","created_at":"2026-09-14T09:33:05.084Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"948af05728e77e8a7fa563f00bc75c97","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.089Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7a877ac94581265589a42554: start","job_status":"start","queue_duration_s":2.666123,"scheduling_latency_s":2.666142}1722vm-test-run-nixbot-gitlab> gitlab # [ 311.104836] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.763Z","class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","database":"ci","message":"Skipping Database::BackgroundOperation::CiSchedulerCellLocalWorker execution for database that shares database configuration with another database","retry":0}1723vm-test-run-nixbot-gitlab> gitlab # [ 311.108380] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.769Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::CiSchedulerCellLocalWorker","jid":"7a877ac94581265589a42554","created_at":"2026-09-14T09:33:05.084Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"948af05728e77e8a7fa563f00bc75c97","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:8b555168ccdb6ae74d10de2e5fe446d2cd23b814df22448d98e7a3685b03eba6","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.089Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::CiSchedulerCellLocalWorker JID-7a877ac94581265589a42554: done: 0.013168 sec","job_status":"done","queue_duration_s":2.666123,"scheduling_latency_s":2.666142,"redis_calls":8,"redis_duration_s":0.0010999999999999998,"redis_read_bytes":133,"redis_write_bytes":931,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000114,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000703,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":557,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000283,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":264,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008657,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.013168,"completed_at":"2026-09-14T09:33:07.768Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1724vm-test-run-nixbot-gitlab> gitlab # [ 311.149901] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.770Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ce19ea79d925e278149c860e","created_at":"2026-09-14T09:33:05.105Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f9d42034c17b46cdc2cd067c0c857ff","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.122Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ce19ea79d925e278149c860e: start","job_status":"start","queue_duration_s":2.647587,"scheduling_latency_s":2.647605}1725vm-test-run-nixbot-gitlab> gitlab # [ 311.163493] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.806Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker","jid":"ce19ea79d925e278149c860e","created_at":"2026-09-14T09:33:05.105Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"2f9d42034c17b46cdc2cd067c0c857ff","meta.root_caller_id":"Cronjob","meta.feature_category":"groups_and_projects","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:b794e71d9c486ce6fd40978731717a0676e95bc1365a385a9a037f2f3c02ae2a","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.122Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Namespaces::ProcessOutdatedNamespaceDescendantsCronWorker JID-ce19ea79d925e278149c860e: done: 0.036602 sec","job_status":"done","queue_duration_s":2.647587,"scheduling_latency_s":2.647605,"redis_calls":8,"redis_duration_s":0.001661,"redis_read_bytes":133,"redis_write_bytes":936,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000361,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":110,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001009,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000291,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":1,"db_write_count":1,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.021,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.021,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011166,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.namespaces_process_outdated_namespace_descendants_cron_worker.result":{},"duration_s":0.036602,"completed_at":"2026-09-14T09:33:07.806Z","load_balancing_strategy":"primary","db_duration_s":0.020649,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1726vm-test-run-nixbot-gitlab> gitlab # [ 311.204757] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.808Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"cd87c8372098e40d4c3e53d2","created_at":"2026-09-14T09:33:05.182Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.193Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-cd87c8372098e40d4c3e53d2: start","job_status":"start","queue_duration_s":2.614602,"scheduling_latency_s":2.614621}1727vm-test-run-nixbot-gitlab> gitlab # [ 311.217992] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.900Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","jid":"cd87c8372098e40d4c3e53d2","created_at":"2026-09-14T09:33:05.182Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:96987dbff74cf5606dd015c238540c0a2d4ff0cd1d1c93a64fda0dd15251e306","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.193Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::ScheduleUnlockPipelinesInQueueCronWorker JID-cd87c8372098e40d4c3e53d2: done: 0.092052 sec","job_status":"done","queue_duration_s":2.614602,"scheduling_latency_s":2.614621,"redis_calls":65,"redis_duration_s":0.009705,"redis_read_bytes":748,"redis_write_bytes":41502,"redis_feature_flag_calls":5,"redis_feature_flag_duration_s":0.0006,"redis_feature_flag_read_bytes":640,"redis_feature_flag_write_bytes":393,"redis_queues_calls":2,"redis_queues_duration_s":0.000574,"redis_queues_read_bytes":3,"redis_queues_write_bytes":37485,"redis_queues_metadata_calls":55,"redis_queues_metadata_duration_s":0.008077,"redis_queues_metadata_read_bytes":104,"redis_queues_metadata_write_bytes":3324,"redis_shared_state_calls":3,"redis_shared_state_duration_s":0.000454,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":300,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.084038,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.092052,"completed_at":"2026-09-14T09:33:07.900Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1728vm-test-run-nixbot-gitlab> gitlab # [ 311.259456] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.901Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e2e95bfd67d77ddc61f2387b","created_at":"2026-09-14T09:33:05.225Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8432bfe4b77a32aba6e6c998ef4812d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.231Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e2e95bfd67d77ddc61f2387b: start","job_status":"start","queue_duration_s":2.670126,"scheduling_latency_s":2.670145}1729vm-test-run-nixbot-gitlab> gitlab # [ 311.274175] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.920Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"MergeRequests::ProcessScheduledMergeWorker","jid":"e2e95bfd67d77ddc61f2387b","created_at":"2026-09-14T09:33:05.225Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"c8432bfe4b77a32aba6e6c998ef4812d","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"idempotency_key":"resque:gitlab:duplicate:default:a6d655d277495cf53e182e80822575dacc8a3389eea573549908a88faf373827","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.231Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequests::ProcessScheduledMergeWorker JID-e2e95bfd67d77ddc61f2387b: done: 0.018925 sec","job_status":"done","queue_duration_s":2.670126,"scheduling_latency_s":2.670145,"redis_calls":10,"redis_duration_s":0.0014219999999999999,"redis_read_bytes":135,"redis_write_bytes":1167,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000113,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":95,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.000681,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":512,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000628,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":560,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.011608,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.0004928,"exclusive_lock_hold_duration_s":0.00566884,"duration_s":0.018925,"completed_at":"2026-09-14T09:33:07.920Z","load_balancing_strategy":"primary","db_duration_s":0.003087,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1730vm-test-run-nixbot-gitlab> gitlab # [ 311.314597] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.921Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"c7fed8cbd5d00ea086e482e8","created_at":"2026-09-14T09:33:05.266Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbef33f056d99331b46afa397ae3eeb0","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.292Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-c7fed8cbd5d00ea086e482e8: start","job_status":"start","queue_duration_s":2.629217,"scheduling_latency_s":2.629234}1731vm-test-run-nixbot-gitlab> gitlab # [ 311.329021] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.944Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Ci::Catalog::Resources::ProcessSyncEventsWorker","jid":"c7fed8cbd5d00ea086e482e8","created_at":"2026-09-14T09:33:05.266Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dbef33f056d99331b46afa397ae3eeb0","meta.root_caller_id":"Cronjob","meta.feature_category":"pipeline_composition","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:bdea4bf4c16667cd22a226e829c85f9746ee8d058f39e317ef84659d4044477c","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.292Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::Catalog::Resources::ProcessSyncEventsWorker JID-c7fed8cbd5d00ea086e482e8: done: 0.022422 sec","job_status":"done","queue_duration_s":2.629217,"scheduling_latency_s":2.629234,"redis_calls":11,"redis_duration_s":0.001597,"redis_read_bytes":136,"redis_write_bytes":1339,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00012,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":100,"redis_queues_metadata_calls":6,"redis_queues_metadata_duration_s":0.00085,"redis_queues_metadata_read_bytes":5,"redis_queues_metadata_write_bytes":636,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.000627,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":603,"db_count":3,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.004,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.004,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0.0067618,"extra.ci_catalog_resources_process_sync_events_worker.estimated_total_events":0,"extra.ci_catalog_resources_process_sync_events_worker.consumable_events":0,"duration_s":0.022422,"completed_at":"2026-09-14T09:33:07.943Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004169,"urgency":"high","target_duration_s":10,"target_scheduling_latency_s":10}1732vm-test-run-nixbot-gitlab> gitlab # [ 311.372915] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.945Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"092e711b1a0d7ce1f7813881","created_at":"2026-09-14T09:33:05.315Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dcd8479036a4872c9b7eb186b65bbb5d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.329Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-092e711b1a0d7ce1f7813881: start","job_status":"start","queue_duration_s":2.6153,"scheduling_latency_s":2.615317}1733vm-test-run-nixbot-gitlab> gitlab # [ 311.386910] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.992Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker","jid":"092e711b1a0d7ce1f7813881","created_at":"2026-09-14T09:33:05.315Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"dcd8479036a4872c9b7eb186b65bbb5d","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:e003caf073151f1134b113654ee6c14127eb98e5e1dd1956c06ead380cd79bba","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.329Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"LooseForeignKeys::CiPipelinesBuildsCleanupCronWorker JID-092e711b1a0d7ce1f7813881: done: 0.047434 sec","job_status":"done","queue_duration_s":2.6153,"scheduling_latency_s":2.615317,"redis_calls":10,"redis_duration_s":0.002346,"redis_read_bytes":135,"redis_write_bytes":1267,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.00012,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":105,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001137,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":551,"redis_shared_state_calls":4,"redis_shared_state_duration_s":0.001089,"redis_shared_state_read_bytes":3,"redis_shared_state_write_bytes":611,"db_count":6,"db_write_count":0,"db_cached_count":2,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":6,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":2,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.008,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":6,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":2,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.008,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.033812,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":2,"exclusive_lock_wait_duration_s":0.00049376,"exclusive_lock_hold_duration_s":0.0267393,"extra.loose_foreign_keys_ci_pipelines_builds_cleanup_cron_worker.stats":{"over_limit":false,"delete_count_by_table":{},"update_count_by_table":{},"delete_count":0,"update_count":0,"turbo_mode":false},"duration_s":0.047434,"completed_at":"2026-09-14T09:33:07.992Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.00937,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1734vm-test-run-nixbot-gitlab> gitlab # [ 311.430142] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:07.995Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a3e9e4815658530d366160c7","created_at":"2026-09-14T09:33:05.378Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59c0a31b591993e02d035b3647dfcaeb","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.399Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a3e9e4815658530d366160c7: start","job_status":"start","queue_duration_s":2.595679,"scheduling_latency_s":2.595716}1735vm-test-run-nixbot-gitlab> gitlab # [ 311.444031] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.023Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"UserStatusCleanup::BatchWorker","jid":"a3e9e4815658530d366160c7","created_at":"2026-09-14T09:33:05.378Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"59c0a31b591993e02d035b3647dfcaeb","meta.root_caller_id":"Cronjob","meta.feature_category":"user_profile","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:63596f84f2aa01599e5d284b58c5b497d0d152817e7aa09bae73984558ee32bf","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.399Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"UserStatusCleanup::BatchWorker JID-a3e9e4815658530d366160c7: done: 0.027857 sec","job_status":"done","queue_duration_s":2.595679,"scheduling_latency_s":2.595716,"redis_calls":8,"redis_duration_s":0.002319,"redis_read_bytes":133,"redis_write_bytes":764,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000233,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":83,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001307,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":473,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.000779,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":208,"db_count":1,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":1,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.003,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":1,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.003,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.017154,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.027857,"completed_at":"2026-09-14T09:33:08.023Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.002498,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1736vm-test-run-nixbot-gitlab> gitlab # [ 311.485799] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.025Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"11e8a8ea8952582d7ef83c2d","created_at":"2026-09-14T09:33:05.464Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8d056523a7111b47dd1642ad37ce812","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.474Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-11e8a8ea8952582d7ef83c2d: start","job_status":"start","queue_duration_s":2.550321,"scheduling_latency_s":2.550351}1737vm-test-run-nixbot-gitlab> gitlab # [ 311.499329] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.063Z","retry":3,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Cells::LostTransactionRecoveryWorker","jid":"11e8a8ea8952582d7ef83c2d","created_at":"2026-09-14T09:33:05.464Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"a8d056523a7111b47dd1642ad37ce812","meta.root_caller_id":"Cronjob","meta.feature_category":"cell","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:0fd4def8dd5675dcd84c556c4d40bc905cecfdb470c7c1510e8a70079f5c8a13","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.474Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Cells::LostTransactionRecoveryWorker JID-11e8a8ea8952582d7ef83c2d: done: 0.03809 sec","job_status":"done","queue_duration_s":2.550321,"scheduling_latency_s":2.550351,"redis_calls":11,"redis_duration_s":0.006218,"redis_read_bytes":517,"redis_write_bytes":1011,"redis_feature_flag_calls":4,"redis_feature_flag_duration_s":0.003168,"redis_feature_flag_read_bytes":512,"redis_feature_flag_write_bytes":300,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001713,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":491,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.001337,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":220,"db_count":2,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":2,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.005,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":2,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.005,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.023128,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.03809,"completed_at":"2026-09-14T09:33:08.063Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.004991,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1738vm-test-run-nixbot-gitlab> gitlab # [ 311.539826] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.065Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"b94c2db3a410c52bee0c89c5","created_at":"2026-09-14T09:33:05.499Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"236a25af00c874bad6b6595390ab0e9f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.511Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-b94c2db3a410c52bee0c89c5: start","job_status":"start","queue_duration_s":2.553535,"scheduling_latency_s":2.553564}1739vm-test-run-nixbot-gitlab> gitlab # [ 311.554075] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.077Z","class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","database":"sec","message":"Skipping Database::BackgroundOperation::SecSchedulerCellLocalWorker execution for unconfigured database sec","retry":0}1740vm-test-run-nixbot-gitlab> gitlab # [ 311.557698] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.085Z","retry":0,"queue":"default","version":0,"store":null,"queue_namespace":"cronjob","args":[],"class":"Database::BackgroundOperation::SecSchedulerCellLocalWorker","jid":"b94c2db3a410c52bee0c89c5","created_at":"2026-09-14T09:33:05.499Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-befef57944764d6a","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-environment=,sentry-release=Unknown"},"meta.caller_id":"Cronjob","correlation_id":"236a25af00c874bad6b6595390ab0e9f","meta.root_caller_id":"Cronjob","meta.feature_category":"database","worker_data_consistency":"sticky","worker_data_consistency_per_db":{"main":"sticky","ci":"sticky"},"wal_locations":{},"wal_location_sources":{"main":"primary","ci":"primary"},"idempotency_key":"resque:gitlab:duplicate:default:537c22ffe7dac982b6d86e5b8becfbed4376cc52983c5f1974bcd576563bd73a","size_limiter":"validated","enqueued_at":"2026-09-14T09:33:05.511Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Database::BackgroundOperation::SecSchedulerCellLocalWorker JID-b94c2db3a410c52bee0c89c5: done: 0.019726 sec","job_status":"done","queue_duration_s":2.553535,"scheduling_latency_s":2.553564,"redis_calls":8,"redis_duration_s":0.001944,"redis_read_bytes":133,"redis_write_bytes":937,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000178,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":111,"redis_queues_metadata_calls":5,"redis_queues_metadata_duration_s":0.001336,"redis_queues_metadata_read_bytes":4,"redis_queues_metadata_write_bytes":560,"redis_shared_state_calls":2,"redis_shared_state_duration_s":0.00043,"redis_shared_state_read_bytes":1,"redis_shared_state_write_bytes":266,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012886,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019726,"completed_at":"2026-09-14T09:33:08.085Z","load_balancing_strategy":"primary_no_wal","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1741vm-test-run-nixbot-gitlab> gitlab # [ 311.599652] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.086Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"525281826c6d7b658168181d","created_at":"2026-09-14T09:33:06.209Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-bfe137d5c6724fca","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99a03af23e05a3c1c4d73e4071b5723b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:06.235Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-525281826c6d7b658168181d: start","job_status":"start","queue_duration_s":1.850895,"scheduling_latency_s":1.850919}1742vm-test-run-nixbot-gitlab> gitlab # [ 311.612051] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.101Z","message":"No existing merge request to be cleaned up."}1743vm-test-run-nixbot-gitlab> gitlab # [ 311.613681] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.111Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"525281826c6d7b658168181d","created_at":"2026-09-14T09:33:06.209Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-bfe137d5c6724fca","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99a03af23e05a3c1c4d73e4071b5723b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:06.235Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-525281826c6d7b658168181d: done: 0.024309 sec","job_status":"done","queue_duration_s":1.850895,"scheduling_latency_s":1.850919,"redis_calls":11,"redis_duration_s":0.001894,"redis_read_bytes":136,"redis_write_bytes":1104,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000151,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":82,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000737,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.016845,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.024309,"completed_at":"2026-09-14T09:33:08.110Z","load_balancing_strategy":"primary","db_duration_s":0.001735,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1744vm-test-run-nixbot-gitlab> gitlab # [ 311.653395] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.112Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c84cd0b4d8796fb7e73b2b99","created_at":"2026-09-14T09:33:06.209Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-bfe137d5c6724fca","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99a03af23e05a3c1c4d73e4071b5723b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:06.235Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c84cd0b4d8796fb7e73b2b99: start","job_status":"start","queue_duration_s":1.876456,"scheduling_latency_s":1.876476}1745vm-test-run-nixbot-gitlab> gitlab # [ 311.665627] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.128Z","message":"No existing merge request to be cleaned up."}1746vm-test-run-nixbot-gitlab> gitlab # [ 311.667276] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.137Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"c84cd0b4d8796fb7e73b2b99","created_at":"2026-09-14T09:33:06.209Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-bfe137d5c6724fca","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99a03af23e05a3c1c4d73e4071b5723b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:06.235Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-c84cd0b4d8796fb7e73b2b99: done: 0.025129 sec","job_status":"done","queue_duration_s":1.876456,"scheduling_latency_s":1.876476,"redis_calls":10,"redis_duration_s":0.0018449999999999999,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000787,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.001058,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015783,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.025129,"completed_at":"2026-09-14T09:33:08.137Z","load_balancing_strategy":"primary","db_duration_s":0.00172,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1747vm-test-run-nixbot-gitlab> gitlab # [ 311.706663] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.138Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"85127642bfb6c3cdee6a2281","created_at":"2026-09-14T09:33:06.209Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-bfe137d5c6724fca","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99a03af23e05a3c1c4d73e4071b5723b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:06.235Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-85127642bfb6c3cdee6a2281: start","job_status":"start","queue_duration_s":1.902843,"scheduling_latency_s":1.902865}1748vm-test-run-nixbot-gitlab> gitlab # [ 311.718935] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.149Z","message":"No existing merge request to be cleaned up."}1749vm-test-run-nixbot-gitlab> gitlab # [ 311.720660] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.158Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"85127642bfb6c3cdee6a2281","created_at":"2026-09-14T09:33:06.209Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-bfe137d5c6724fca","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99a03af23e05a3c1c4d73e4071b5723b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:06.235Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-85127642bfb6c3cdee6a2281: done: 0.019581 sec","job_status":"done","queue_duration_s":1.902843,"scheduling_latency_s":1.902865,"redis_calls":10,"redis_duration_s":0.001555,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000621,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000934,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.014072,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.019581,"completed_at":"2026-09-14T09:33:08.158Z","load_balancing_strategy":"primary","db_duration_s":0.00137,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1750vm-test-run-nixbot-gitlab> gitlab # [ 311.759080] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.159Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b3927dbfc14e086ec4046fda","created_at":"2026-09-14T09:33:06.209Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-bfe137d5c6724fca","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99a03af23e05a3c1c4d73e4071b5723b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:06.235Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b3927dbfc14e086ec4046fda: start","job_status":"start","queue_duration_s":1.923601,"scheduling_latency_s":1.923623}1751vm-test-run-nixbot-gitlab> gitlab # [ 311.771466] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.169Z","message":"No existing merge request to be cleaned up."}1752vm-test-run-nixbot-gitlab> gitlab # [ 311.773241] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.177Z","retry":3,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"MergeRequestCleanupRefsWorker","args":[],"jid":"b3927dbfc14e086ec4046fda","created_at":"2026-09-14T09:33:06.209Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-bfe137d5c6724fca","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"ScheduleMergeRequestCleanupRefsWorker","correlation_id":"99a03af23e05a3c1c4d73e4071b5723b","meta.root_caller_id":"Cronjob","meta.feature_category":"code_review_workflow","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:06.235Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"MergeRequestCleanupRefsWorker JID-b3927dbfc14e086ec4046fda: done: 0.017861 sec","job_status":"done","queue_duration_s":1.923601,"scheduling_latency_s":1.923623,"redis_calls":10,"redis_duration_s":0.001423,"redis_read_bytes":8,"redis_write_bytes":1022,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000574,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":353,"redis_shared_state_calls":6,"redis_shared_state_duration_s":0.000849,"redis_shared_state_read_bytes":5,"redis_shared_state_write_bytes":669,"db_count":3,"db_write_count":1,"db_cached_count":1,"db_txn_count":1,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":3,"db_replica_write_count":0,"db_primary_write_count":1,"db_replica_cached_count":0,"db_primary_cached_count":1,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.001,"db_main_txn_count":1,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":3,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":1,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":1,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.001,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.001,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.001,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012559,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"duration_s":0.017861,"completed_at":"2026-09-14T09:33:08.177Z","load_balancing_strategy":"primary","db_duration_s":0.001251,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1753vm-test-run-nixbot-gitlab> gitlab # [ 311.811168] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.178Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6301b9f6fd2863b80ab47587","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6301b9f6fd2863b80ab47587: start","job_status":"start","queue_duration_s":0.2852,"scheduling_latency_s":0.285223}1754vm-test-run-nixbot-gitlab> gitlab # [ 311.823531] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.193Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6301b9f6fd2863b80ab47587","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6301b9f6fd2863b80ab47587: done: 0.01539 sec","job_status":"done","queue_duration_s":0.2852,"scheduling_latency_s":0.285223,"redis_calls":14,"redis_duration_s":0.0015789999999999999,"redis_read_bytes":138,"redis_write_bytes":1242,"redis_feature_flag_calls":1,"redis_feature_flag_duration_s":0.000117,"redis_feature_flag_read_bytes":128,"redis_feature_flag_write_bytes":85,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000936,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010379,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01539,"completed_at":"2026-09-14T09:33:08.193Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1755vm-test-run-nixbot-gitlab> gitlab # [ 311.864135] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.195Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ac3bd1f90553fbe3d2f72b1","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ac3bd1f90553fbe3d2f72b1: start","job_status":"start","queue_duration_s":0.301816,"scheduling_latency_s":0.301838}1756vm-test-run-nixbot-gitlab> gitlab # [ 311.876329] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.209Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2ac3bd1f90553fbe3d2f72b1","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2ac3bd1f90553fbe3d2f72b1: done: 0.014697 sec","job_status":"done","queue_duration_s":0.301816,"scheduling_latency_s":0.301838,"redis_calls":13,"redis_duration_s":0.001541,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000981,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009962,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014697,"completed_at":"2026-09-14T09:33:08.209Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1757vm-test-run-nixbot-gitlab> gitlab # [ 311.915459] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.210Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b209d90b828bf882da3b090","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b209d90b828bf882da3b090: start","job_status":"start","queue_duration_s":0.317667,"scheduling_latency_s":0.317689}1758vm-test-run-nixbot-gitlab> gitlab # [ 311.927820] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.225Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5b209d90b828bf882da3b090","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5b209d90b828bf882da3b090: done: 0.014143 sec","job_status":"done","queue_duration_s":0.317667,"scheduling_latency_s":0.317689,"redis_calls":13,"redis_duration_s":0.001425,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014143,"completed_at":"2026-09-14T09:33:08.225Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1759vm-test-run-nixbot-gitlab> gitlab # [ 311.967189] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.226Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffdf11de129e660eb509a82d","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffdf11de129e660eb509a82d: start","job_status":"start","queue_duration_s":0.333002,"scheduling_latency_s":0.333023}1760vm-test-run-nixbot-gitlab> gitlab # [ 311.979628] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.240Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ffdf11de129e660eb509a82d","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ffdf11de129e660eb509a82d: done: 0.013853 sec","job_status":"done","queue_duration_s":0.333002,"scheduling_latency_s":0.333023,"redis_calls":13,"redis_duration_s":0.0014320000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000519,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009382,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013853,"completed_at":"2026-09-14T09:33:08.240Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1761vm-test-run-nixbot-gitlab> gitlab # [ 312.018662] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.241Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02374d934530220c04c3576f","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02374d934530220c04c3576f: start","job_status":"start","queue_duration_s":0.348065,"scheduling_latency_s":0.348087}1762vm-test-run-nixbot-gitlab> gitlab # [ 312.031036] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.255Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"02374d934530220c04c3576f","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-02374d934530220c04c3576f: done: 0.013925 sec","job_status":"done","queue_duration_s":0.348065,"scheduling_latency_s":0.348087,"redis_calls":13,"redis_duration_s":0.0014069999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.0009,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009476,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013925,"completed_at":"2026-09-14T09:33:08.255Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1763vm-test-run-nixbot-gitlab> gitlab # [ 312.070780] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.256Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5c1f165230d550ce5696410","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5c1f165230d550ce5696410: start","job_status":"start","queue_duration_s":0.363137,"scheduling_latency_s":0.363159}1764vm-test-run-nixbot-gitlab> gitlab # [ 312.083324] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.270Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b5c1f165230d550ce5696410","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b5c1f165230d550ce5696410: done: 0.014302 sec","job_status":"done","queue_duration_s":0.363137,"scheduling_latency_s":0.363159,"redis_calls":13,"redis_duration_s":0.001554,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000539,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001015,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009654,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014302,"completed_at":"2026-09-14T09:33:08.270Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1765vm-test-run-nixbot-gitlab> gitlab # [ 312.122935] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.271Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ec0c87fcf448062a0cb294d","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ec0c87fcf448062a0cb294d: start","job_status":"start","queue_duration_s":0.378606,"scheduling_latency_s":0.378629}1766vm-test-run-nixbot-gitlab> gitlab # [ 312.135641] gitaly[912]: time="2026-09-14T09:33:08.896Z" level=info msg="burden monitor stats" pid=9121767vm-test-run-nixbot-gitlab> gitlab # [ 312.136971] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.286Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"3ec0c87fcf448062a0cb294d","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-3ec0c87fcf448062a0cb294d: done: 0.014221 sec","job_status":"done","queue_duration_s":0.378606,"scheduling_latency_s":0.378629,"redis_calls":13,"redis_duration_s":0.00161,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001097,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009445,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014221,"completed_at":"2026-09-14T09:33:08.286Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1768vm-test-run-nixbot-gitlab> gitlab # [ 312.176136] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.287Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49e28dd8954a15f4c96f5f28","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49e28dd8954a15f4c96f5f28: start","job_status":"start","queue_duration_s":0.394019,"scheduling_latency_s":0.394043}1769vm-test-run-nixbot-gitlab> gitlab # [ 312.188190] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.301Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"49e28dd8954a15f4c96f5f28","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-49e28dd8954a15f4c96f5f28: done: 0.013976 sec","job_status":"done","queue_duration_s":0.394019,"scheduling_latency_s":0.394043,"redis_calls":13,"redis_duration_s":0.001409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000526,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000883,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009341,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013976,"completed_at":"2026-09-14T09:33:08.301Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1770vm-test-run-nixbot-gitlab> gitlab # [ 312.227340] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.302Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9feba0f633220a6aad56103f","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9feba0f633220a6aad56103f: start","job_status":"start","queue_duration_s":0.409244,"scheduling_latency_s":0.409268}1771vm-test-run-nixbot-gitlab> gitlab # [ 312.239858] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.316Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9feba0f633220a6aad56103f","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9feba0f633220a6aad56103f: done: 0.013934 sec","job_status":"done","queue_duration_s":0.409244,"scheduling_latency_s":0.409268,"redis_calls":13,"redis_duration_s":0.001386,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009306,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013934,"completed_at":"2026-09-14T09:33:08.316Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1772vm-test-run-nixbot-gitlab> gitlab # [ 312.278904] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.317Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f85b1506e8ba1a1d3f0a00a","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f85b1506e8ba1a1d3f0a00a: start","job_status":"start","queue_duration_s":0.424447,"scheduling_latency_s":0.424471}1773vm-test-run-nixbot-gitlab> gitlab # [ 312.291474] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.332Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5f85b1506e8ba1a1d3f0a00a","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5f85b1506e8ba1a1d3f0a00a: done: 0.01441 sec","job_status":"done","queue_duration_s":0.424447,"scheduling_latency_s":0.424471,"redis_calls":13,"redis_duration_s":0.0014169999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0005,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000917,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009462,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01441,"completed_at":"2026-09-14T09:33:08.332Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1774vm-test-run-nixbot-gitlab> gitlab # [ 312.332110] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.333Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c10378bc06168c2054ef3de","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c10378bc06168c2054ef3de: start","job_status":"start","queue_duration_s":0.440148,"scheduling_latency_s":0.440173}1775vm-test-run-nixbot-gitlab> gitlab # [ 312.344280] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.347Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"9c10378bc06168c2054ef3de","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-9c10378bc06168c2054ef3de: done: 0.014298 sec","job_status":"done","queue_duration_s":0.440148,"scheduling_latency_s":0.440173,"redis_calls":13,"redis_duration_s":0.001527,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000521,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001006,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009569,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014298,"completed_at":"2026-09-14T09:33:08.347Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1776vm-test-run-nixbot-gitlab> gitlab # [ 312.382896] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.349Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f3c20eed482b17ac3ac30d0","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f3c20eed482b17ac3ac30d0: start","job_status":"start","queue_duration_s":0.455831,"scheduling_latency_s":0.45588}1777vm-test-run-nixbot-gitlab> gitlab # [ 312.395108] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.363Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"8f3c20eed482b17ac3ac30d0","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-8f3c20eed482b17ac3ac30d0: done: 0.014041 sec","job_status":"done","queue_duration_s":0.455831,"scheduling_latency_s":0.45588,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000514,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000923,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009549,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014041,"completed_at":"2026-09-14T09:33:08.363Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1778vm-test-run-nixbot-gitlab> gitlab # [ 312.433990] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.364Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66f34f6708fb8e59fa5b34dc","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66f34f6708fb8e59fa5b34dc: start","job_status":"start","queue_duration_s":0.470905,"scheduling_latency_s":0.470923}1779vm-test-run-nixbot-gitlab> gitlab # [ 312.446493] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.377Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"66f34f6708fb8e59fa5b34dc","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-66f34f6708fb8e59fa5b34dc: done: 0.013726 sec","job_status":"done","queue_duration_s":0.470905,"scheduling_latency_s":0.470923,"redis_calls":13,"redis_duration_s":0.001401,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000503,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009351,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013726,"completed_at":"2026-09-14T09:33:08.377Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1780vm-test-run-nixbot-gitlab> gitlab # [ 312.485624] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.379Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"766d9ed5bf52f001dadf7a34","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-766d9ed5bf52f001dadf7a34: start","job_status":"start","queue_duration_s":0.485706,"scheduling_latency_s":0.485722}1781vm-test-run-nixbot-gitlab> gitlab # [ 312.498182] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.393Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"766d9ed5bf52f001dadf7a34","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-766d9ed5bf52f001dadf7a34: done: 0.014103 sec","job_status":"done","queue_duration_s":0.485706,"scheduling_latency_s":0.485722,"redis_calls":13,"redis_duration_s":0.001433,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000902,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009517,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014103,"completed_at":"2026-09-14T09:33:08.393Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1782vm-test-run-nixbot-gitlab> gitlab # [ 312.538234] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.394Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71c253398e5e91500c2fc459","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71c253398e5e91500c2fc459: start","job_status":"start","queue_duration_s":0.500891,"scheduling_latency_s":0.500908}1783vm-test-run-nixbot-gitlab> gitlab # [ 312.550751] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.408Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"71c253398e5e91500c2fc459","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-71c253398e5e91500c2fc459: done: 0.014172 sec","job_status":"done","queue_duration_s":0.500891,"scheduling_latency_s":0.500908,"redis_calls":13,"redis_duration_s":0.0018579999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000844,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001014,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009465,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014172,"completed_at":"2026-09-14T09:33:08.408Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1784vm-test-run-nixbot-gitlab> gitlab # [ 312.590207] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.409Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e76d01c38919b0b6a709106","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e76d01c38919b0b6a709106: start","job_status":"start","queue_duration_s":0.516451,"scheduling_latency_s":0.516468}1785vm-test-run-nixbot-gitlab> gitlab # [ 312.602693] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.424Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"5e76d01c38919b0b6a709106","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-5e76d01c38919b0b6a709106: done: 0.014681 sec","job_status":"done","queue_duration_s":0.516451,"scheduling_latency_s":0.516468,"redis_calls":13,"redis_duration_s":0.00237,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000736,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001634,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009323,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014681,"completed_at":"2026-09-14T09:33:08.424Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1786vm-test-run-nixbot-gitlab> gitlab # [ 312.641909] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.425Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"516196729611cbc5b8e192d6","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-516196729611cbc5b8e192d6: start","job_status":"start","queue_duration_s":0.532239,"scheduling_latency_s":0.532256}1787vm-test-run-nixbot-gitlab> gitlab # [ 312.654409] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.439Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"516196729611cbc5b8e192d6","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-516196729611cbc5b8e192d6: done: 0.013638 sec","job_status":"done","queue_duration_s":0.532239,"scheduling_latency_s":0.532256,"redis_calls":13,"redis_duration_s":0.0014169999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000502,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009367,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013638,"completed_at":"2026-09-14T09:33:08.439Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1788vm-test-run-nixbot-gitlab> gitlab # [ 312.693708] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.440Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa3d67e746855868e0359f41","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa3d67e746855868e0359f41: start","job_status":"start","queue_duration_s":0.546925,"scheduling_latency_s":0.546942}1789vm-test-run-nixbot-gitlab> gitlab # [ 312.706151] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.454Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"aa3d67e746855868e0359f41","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-aa3d67e746855868e0359f41: done: 0.014066 sec","job_status":"done","queue_duration_s":0.546925,"scheduling_latency_s":0.546942,"redis_calls":13,"redis_duration_s":0.001495,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000541,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000954,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009583,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014066,"completed_at":"2026-09-14T09:33:08.454Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1790vm-test-run-nixbot-gitlab> gitlab # [ 312.746446] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.455Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"840a3860b7d0c81b7bdf1a01","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-840a3860b7d0c81b7bdf1a01: start","job_status":"start","queue_duration_s":0.562057,"scheduling_latency_s":0.562074}1791vm-test-run-nixbot-gitlab> gitlab # [ 312.758888] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.468Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"840a3860b7d0c81b7bdf1a01","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-840a3860b7d0c81b7bdf1a01: done: 0.013563 sec","job_status":"done","queue_duration_s":0.562057,"scheduling_latency_s":0.562074,"redis_calls":13,"redis_duration_s":0.001409,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000527,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009394,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013563,"completed_at":"2026-09-14T09:33:08.468Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1792vm-test-run-nixbot-gitlab> gitlab # [ 312.797875] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.469Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"defaea2608375ea9dbebba83","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-defaea2608375ea9dbebba83: start","job_status":"start","queue_duration_s":0.576689,"scheduling_latency_s":0.576707}1793vm-test-run-nixbot-gitlab> gitlab # [ 312.810339] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.483Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"defaea2608375ea9dbebba83","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-defaea2608375ea9dbebba83: done: 0.013441 sec","job_status":"done","queue_duration_s":0.576689,"scheduling_latency_s":0.576707,"redis_calls":13,"redis_duration_s":0.001437,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000522,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013441,"completed_at":"2026-09-14T09:33:08.483Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1794vm-test-run-nixbot-gitlab> gitlab # [ 312.849725] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.484Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca85987bd1c61d3ee2952c15","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca85987bd1c61d3ee2952c15: start","job_status":"start","queue_duration_s":0.59162,"scheduling_latency_s":0.591636}1795vm-test-run-nixbot-gitlab> gitlab # [ 312.862154] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.498Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"ca85987bd1c61d3ee2952c15","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-ca85987bd1c61d3ee2952c15: done: 0.013935 sec","job_status":"done","queue_duration_s":0.59162,"scheduling_latency_s":0.591636,"redis_calls":13,"redis_duration_s":0.002017,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000844,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001173,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009206,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013935,"completed_at":"2026-09-14T09:33:08.498Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1796vm-test-run-nixbot-gitlab> gitlab # [ 312.901143] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.499Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb8990fbb7f65334bc2898a2","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb8990fbb7f65334bc2898a2: start","job_status":"start","queue_duration_s":0.606631,"scheduling_latency_s":0.606649}1797vm-test-run-nixbot-gitlab> gitlab # [ 312.913577] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.513Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bb8990fbb7f65334bc2898a2","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bb8990fbb7f65334bc2898a2: done: 0.013767 sec","job_status":"done","queue_duration_s":0.606631,"scheduling_latency_s":0.606649,"redis_calls":13,"redis_duration_s":0.00139,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000882,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.00935,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013767,"completed_at":"2026-09-14T09:33:08.513Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1798vm-test-run-nixbot-gitlab> gitlab # [ 312.954030] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.514Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28c88040cca20f23d6b8eae3","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28c88040cca20f23d6b8eae3: start","job_status":"start","queue_duration_s":0.621506,"scheduling_latency_s":0.621523}1799vm-test-run-nixbot-gitlab> gitlab # [ 312.966395] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.528Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"28c88040cca20f23d6b8eae3","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-28c88040cca20f23d6b8eae3: done: 0.01419 sec","job_status":"done","queue_duration_s":0.621506,"scheduling_latency_s":0.621523,"redis_calls":13,"redis_duration_s":0.0016879999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000717,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000971,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.0097,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01419,"completed_at":"2026-09-14T09:33:08.528Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1800vm-test-run-nixbot-gitlab> gitlab # [ 313.005870] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.530Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23c90068ba91fa0e68aa8d7e","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23c90068ba91fa0e68aa8d7e: start","job_status":"start","queue_duration_s":0.636841,"scheduling_latency_s":0.636859}1801vm-test-run-nixbot-gitlab> gitlab # [ 313.018335] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.543Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"23c90068ba91fa0e68aa8d7e","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-23c90068ba91fa0e68aa8d7e: done: 0.01349 sec","job_status":"done","queue_duration_s":0.636841,"scheduling_latency_s":0.636859,"redis_calls":13,"redis_duration_s":0.001379,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000499,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00088,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009344,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01349,"completed_at":"2026-09-14T09:33:08.543Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1802vm-test-run-nixbot-gitlab> gitlab # [ 313.057118] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.544Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc64bcfe519e478d8e67155c","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc64bcfe519e478d8e67155c: start","job_status":"start","queue_duration_s":0.651405,"scheduling_latency_s":0.651422}1803vm-test-run-nixbot-gitlab> gitlab # [ 313.069407] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.558Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"cc64bcfe519e478d8e67155c","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-cc64bcfe519e478d8e67155c: done: 0.013517 sec","job_status":"done","queue_duration_s":0.651405,"scheduling_latency_s":0.651422,"redis_calls":13,"redis_duration_s":0.001388,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000504,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000884,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009374,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.013517,"completed_at":"2026-09-14T09:33:08.558Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1804vm-test-run-nixbot-gitlab> gitlab # [ 313.108044] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.559Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db4d578ebbb602144ee72e3f","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db4d578ebbb602144ee72e3f: start","job_status":"start","queue_duration_s":0.665962,"scheduling_latency_s":0.66598}1805vm-test-run-nixbot-gitlab> gitlab # [ 313.120270] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.593Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"db4d578ebbb602144ee72e3f","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-db4d578ebbb602144ee72e3f: done: 0.034354 sec","job_status":"done","queue_duration_s":0.665962,"scheduling_latency_s":0.66598,"redis_calls":13,"redis_duration_s":0.001405,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000898,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009377,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.034354,"completed_at":"2026-09-14T09:33:08.593Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1806vm-test-run-nixbot-gitlab> gitlab # [ 313.160091] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.595Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d76a798c6173c531c46e7da3","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d76a798c6173c531c46e7da3: start","job_status":"start","queue_duration_s":0.701795,"scheduling_latency_s":0.701811}1807vm-test-run-nixbot-gitlab> gitlab # [ 313.172245] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.610Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"d76a798c6173c531c46e7da3","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-d76a798c6173c531c46e7da3: done: 0.015257 sec","job_status":"done","queue_duration_s":0.701795,"scheduling_latency_s":0.701811,"redis_calls":13,"redis_duration_s":0.001865,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000739,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001126,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010585,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015257,"completed_at":"2026-09-14T09:33:08.610Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1808vm-test-run-nixbot-gitlab> gitlab # [ 313.210952] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.611Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de4acb79e1965dca46e69025","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de4acb79e1965dca46e69025: start","job_status":"start","queue_duration_s":0.718136,"scheduling_latency_s":0.718153}1809vm-test-run-nixbot-gitlab> gitlab # [ 313.223357] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.626Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"de4acb79e1965dca46e69025","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-de4acb79e1965dca46e69025: done: 0.015192 sec","job_status":"done","queue_duration_s":0.718136,"scheduling_latency_s":0.718153,"redis_calls":13,"redis_duration_s":0.001441,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000531,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00091,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010859,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015192,"completed_at":"2026-09-14T09:33:08.626Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1810vm-test-run-nixbot-gitlab> gitlab # [ 313.262059] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.627Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c44d84f83e8a2a1a28b5332d","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c44d84f83e8a2a1a28b5332d: start","job_status":"start","queue_duration_s":0.73436,"scheduling_latency_s":0.734377}1811vm-test-run-nixbot-gitlab> gitlab # [ 313.274443] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.642Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c44d84f83e8a2a1a28b5332d","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c44d84f83e8a2a1a28b5332d: done: 0.015275 sec","job_status":"done","queue_duration_s":0.73436,"scheduling_latency_s":0.734377,"redis_calls":13,"redis_duration_s":0.001443,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000524,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000919,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010134,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015275,"completed_at":"2026-09-14T09:33:08.642Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1812vm-test-run-nixbot-gitlab> gitlab # [ 313.313239] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.644Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d232c1a4a79631abe8cbd4b","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d232c1a4a79631abe8cbd4b: start","job_status":"start","queue_duration_s":0.7507,"scheduling_latency_s":0.750716}1813vm-test-run-nixbot-gitlab> gitlab # [ 313.325558] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.658Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"6d232c1a4a79631abe8cbd4b","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-6d232c1a4a79631abe8cbd4b: done: 0.014453 sec","job_status":"done","queue_duration_s":0.7507,"scheduling_latency_s":0.750716,"redis_calls":13,"redis_duration_s":0.002183,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001271,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000912,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010264,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014453,"completed_at":"2026-09-14T09:33:08.658Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1814vm-test-run-nixbot-gitlab> gitlab # [ 313.365333] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.659Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b51be8037cd32206e33fe22","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b51be8037cd32206e33fe22: start","job_status":"start","queue_duration_s":0.766184,"scheduling_latency_s":0.766201}1815vm-test-run-nixbot-gitlab> gitlab # [ 313.377436] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.675Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1b51be8037cd32206e33fe22","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1b51be8037cd32206e33fe22: done: 0.016064 sec","job_status":"done","queue_duration_s":0.766184,"scheduling_latency_s":0.766201,"redis_calls":13,"redis_duration_s":0.002553,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000814,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001739,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008952,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016064,"completed_at":"2026-09-14T09:33:08.675Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1816vm-test-run-nixbot-gitlab> gitlab # [ 313.416240] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.676Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39c5ab1cc3f95a1eafff4aa3","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39c5ab1cc3f95a1eafff4aa3: start","job_status":"start","queue_duration_s":0.783312,"scheduling_latency_s":0.783329}1817vm-test-run-nixbot-gitlab> gitlab # [ 313.428386] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.692Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"39c5ab1cc3f95a1eafff4aa3","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-39c5ab1cc3f95a1eafff4aa3: done: 0.016164 sec","job_status":"done","queue_duration_s":0.783312,"scheduling_latency_s":0.783329,"redis_calls":13,"redis_duration_s":0.003186,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001118,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.002068,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010256,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016164,"completed_at":"2026-09-14T09:33:08.692Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1818vm-test-run-nixbot-gitlab> gitlab # [ 313.468213] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.693Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b667184a7e2aeb0acbd0c18c","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b667184a7e2aeb0acbd0c18c: start","job_status":"start","queue_duration_s":0.800541,"scheduling_latency_s":0.800558}1819vm-test-run-nixbot-gitlab> gitlab # [ 313.480461] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.708Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"b667184a7e2aeb0acbd0c18c","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-b667184a7e2aeb0acbd0c18c: done: 0.014773 sec","job_status":"done","queue_duration_s":0.800541,"scheduling_latency_s":0.800558,"redis_calls":13,"redis_duration_s":0.0014889999999999999,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000585,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010627,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014773,"completed_at":"2026-09-14T09:33:08.708Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1820vm-test-run-nixbot-gitlab> gitlab # [ 313.519736] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.709Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c0ec73e9a37bcacb8101249","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c0ec73e9a37bcacb8101249: start","job_status":"start","queue_duration_s":0.816447,"scheduling_latency_s":0.816464}1821vm-test-run-nixbot-gitlab> gitlab # [ 313.532522] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.724Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0c0ec73e9a37bcacb8101249","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0c0ec73e9a37bcacb8101249: done: 0.014518 sec","job_status":"done","queue_duration_s":0.816447,"scheduling_latency_s":0.816464,"redis_calls":13,"redis_duration_s":0.001414,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000906,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009239,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014518,"completed_at":"2026-09-14T09:33:08.724Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1822vm-test-run-nixbot-gitlab> gitlab # [ 313.572427] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.726Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1c58f8c1a550fb21757ef12","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1c58f8c1a550fb21757ef12: start","job_status":"start","queue_duration_s":0.832948,"scheduling_latency_s":0.832966}1823vm-test-run-nixbot-gitlab> gitlab # [ 313.584639] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.740Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a1c58f8c1a550fb21757ef12","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a1c58f8c1a550fb21757ef12: done: 0.014349 sec","job_status":"done","queue_duration_s":0.832948,"scheduling_latency_s":0.832966,"redis_calls":13,"redis_duration_s":0.001408,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00053,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000878,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010231,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014349,"completed_at":"2026-09-14T09:33:08.740Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1824vm-test-run-nixbot-gitlab> gitlab # [ 313.623317] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.741Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7d2765a8827c20ee3b99124","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7d2765a8827c20ee3b99124: start","job_status":"start","queue_duration_s":0.848371,"scheduling_latency_s":0.848387}1825vm-test-run-nixbot-gitlab> gitlab # [ 313.635721] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.756Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c7d2765a8827c20ee3b99124","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c7d2765a8827c20ee3b99124: done: 0.014428 sec","job_status":"done","queue_duration_s":0.848371,"scheduling_latency_s":0.848387,"redis_calls":13,"redis_duration_s":0.001428,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000515,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000913,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010348,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014428,"completed_at":"2026-09-14T09:33:08.756Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1826vm-test-run-nixbot-gitlab> gitlab # [ 313.674733] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.759Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7380c59fff9f5d190a1dcb55","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7380c59fff9f5d190a1dcb55: start","job_status":"start","queue_duration_s":0.866094,"scheduling_latency_s":0.866112}1827vm-test-run-nixbot-gitlab> gitlab # [ 313.687052] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.778Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7380c59fff9f5d190a1dcb55","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7380c59fff9f5d190a1dcb55: done: 0.019359 sec","job_status":"done","queue_duration_s":0.866094,"scheduling_latency_s":0.866112,"redis_calls":13,"redis_duration_s":0.001467,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000523,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000944,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.015095,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.019359,"completed_at":"2026-09-14T09:33:08.778Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1828vm-test-run-nixbot-gitlab> gitlab # [ 313.725687] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.779Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"828cf1b44d245b2ebe3db5d4","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-828cf1b44d245b2ebe3db5d4: start","job_status":"start","queue_duration_s":0.886494,"scheduling_latency_s":0.886511}1829vm-test-run-nixbot-gitlab> gitlab # [ 313.737880] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.794Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"828cf1b44d245b2ebe3db5d4","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-828cf1b44d245b2ebe3db5d4: done: 0.014647 sec","job_status":"done","queue_duration_s":0.886494,"scheduling_latency_s":0.886511,"redis_calls":13,"redis_duration_s":0.001614,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.0007,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000914,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014647,"completed_at":"2026-09-14T09:33:08.794Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1830vm-test-run-nixbot-gitlab> gitlab # [ 313.777301] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.796Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5774ac63fe80daf7a6bce1d","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5774ac63fe80daf7a6bce1d: start","job_status":"start","queue_duration_s":0.903058,"scheduling_latency_s":0.903075}1831vm-test-run-nixbot-gitlab> gitlab # [ 313.789610] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.810Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"a5774ac63fe80daf7a6bce1d","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-a5774ac63fe80daf7a6bce1d: done: 0.014609 sec","job_status":"done","queue_duration_s":0.903058,"scheduling_latency_s":0.903075,"redis_calls":13,"redis_duration_s":0.001471,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000567,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000904,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010399,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014609,"completed_at":"2026-09-14T09:33:08.810Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1832vm-test-run-nixbot-gitlab> gitlab # [ 313.828428] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.812Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e462bd92e4c94274a8d2b24d","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e462bd92e4c94274a8d2b24d: start","job_status":"start","queue_duration_s":0.9187,"scheduling_latency_s":0.918717}1833vm-test-run-nixbot-gitlab> gitlab # [ 313.840482] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.827Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"e462bd92e4c94274a8d2b24d","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-e462bd92e4c94274a8d2b24d: done: 0.015367 sec","job_status":"done","queue_duration_s":0.9187,"scheduling_latency_s":0.918717,"redis_calls":13,"redis_duration_s":0.002791,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.001397,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001394,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010695,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.015367,"completed_at":"2026-09-14T09:33:08.827Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1834vm-test-run-nixbot-gitlab> gitlab # [ 313.878901] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.828Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07084e855b1308df8f4fd32b","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07084e855b1308df8f4fd32b: start","job_status":"start","queue_duration_s":0.935132,"scheduling_latency_s":0.935148}1835vm-test-run-nixbot-gitlab> gitlab # [ 313.891391] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.842Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"07084e855b1308df8f4fd32b","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-07084e855b1308df8f4fd32b: done: 0.01433 sec","job_status":"done","queue_duration_s":0.935132,"scheduling_latency_s":0.935148,"redis_calls":13,"redis_duration_s":0.00141,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000501,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.009305,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01433,"completed_at":"2026-09-14T09:33:08.842Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1836vm-test-run-nixbot-gitlab> gitlab # [ 313.929931] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.844Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d3e59264bee6810fa9eaa19","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d3e59264bee6810fa9eaa19: start","job_status":"start","queue_duration_s":0.951452,"scheduling_latency_s":0.951469}1837vm-test-run-nixbot-gitlab> gitlab # [ 313.942068] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.859Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"0d3e59264bee6810fa9eaa19","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-0d3e59264bee6810fa9eaa19: done: 0.01464 sec","job_status":"done","queue_duration_s":0.951452,"scheduling_latency_s":0.951469,"redis_calls":13,"redis_duration_s":0.001553,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.00056,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000993,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010353,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01464,"completed_at":"2026-09-14T09:33:08.859Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1838vm-test-run-nixbot-gitlab> gitlab # [ 313.981901] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.860Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfa9e64e81610c15c5d4d363","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfa9e64e81610c15c5d4d363: start","job_status":"start","queue_duration_s":0.967117,"scheduling_latency_s":0.967134}1839vm-test-run-nixbot-gitlab> gitlab # [ 313.994107] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.874Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"bfa9e64e81610c15c5d4d363","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-bfa9e64e81610c15c5d4d363: done: 0.014357 sec","job_status":"done","queue_duration_s":0.967117,"scheduling_latency_s":0.967134,"redis_calls":13,"redis_duration_s":0.001428,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000507,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000921,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010242,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014357,"completed_at":"2026-09-14T09:33:08.874Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1840vm-test-run-nixbot-gitlab> gitlab # [ 314.032777] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.875Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6b6cc98baee2510abb6ab84","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6b6cc98baee2510abb6ab84: start","job_status":"start","queue_duration_s":0.982497,"scheduling_latency_s":0.982512}1841vm-test-run-nixbot-gitlab> gitlab # [ 314.045107] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.890Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"f6b6cc98baee2510abb6ab84","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-f6b6cc98baee2510abb6ab84: done: 0.01475 sec","job_status":"done","queue_duration_s":0.982497,"scheduling_latency_s":0.982512,"redis_calls":13,"redis_duration_s":0.001624,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000915,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010447,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01475,"completed_at":"2026-09-14T09:33:08.890Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1842vm-test-run-nixbot-gitlab> gitlab # [ 314.083372] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.892Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"973068620a08170898529145","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-973068620a08170898529145: start","job_status":"start","queue_duration_s":0.999382,"scheduling_latency_s":0.9994}1843vm-test-run-nixbot-gitlab> gitlab # [ 314.095544] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.907Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"973068620a08170898529145","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-973068620a08170898529145: done: 0.014769 sec","job_status":"done","queue_duration_s":0.999382,"scheduling_latency_s":0.9994,"redis_calls":13,"redis_duration_s":0.001482,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000573,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000909,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010523,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014769,"completed_at":"2026-09-14T09:33:08.907Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1844vm-test-run-nixbot-gitlab> gitlab # [ 314.133693] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.908Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52bce95b68a18d3ab4bc0d37","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52bce95b68a18d3ab4bc0d37: start","job_status":"start","queue_duration_s":1.015158,"scheduling_latency_s":1.015174}1845vm-test-run-nixbot-gitlab> gitlab # [ 314.145690] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.924Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"52bce95b68a18d3ab4bc0d37","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-52bce95b68a18d3ab4bc0d37: done: 0.01651 sec","job_status":"done","queue_duration_s":1.015158,"scheduling_latency_s":1.015174,"redis_calls":13,"redis_duration_s":0.0017139999999999998,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000571,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001143,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.012063,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.01651,"completed_at":"2026-09-14T09:33:08.924Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1846vm-test-run-nixbot-gitlab> gitlab # [ 314.184238] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.926Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1443a7d275131830ab5d4d0","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1443a7d275131830ab5d4d0: start","job_status":"start","queue_duration_s":1.032765,"scheduling_latency_s":1.032782}1847vm-test-run-nixbot-gitlab> gitlab # [ 314.197115] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.940Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"c1443a7d275131830ab5d4d0","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-c1443a7d275131830ab5d4d0: done: 0.014433 sec","job_status":"done","queue_duration_s":1.032765,"scheduling_latency_s":1.032782,"redis_calls":13,"redis_duration_s":0.0014190000000000001,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000508,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000911,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010364,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014433,"completed_at":"2026-09-14T09:33:08.940Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1848vm-test-run-nixbot-gitlab> gitlab # [ 314.235396] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.941Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fe63ca58b7238256e3edf0a","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fe63ca58b7238256e3edf0a: start","job_status":"start","queue_duration_s":1.048252,"scheduling_latency_s":1.048268}1849vm-test-run-nixbot-gitlab> gitlab # [ 314.247731] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.958Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"2fe63ca58b7238256e3edf0a","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-2fe63ca58b7238256e3edf0a: done: 0.016527 sec","job_status":"done","queue_duration_s":1.048252,"scheduling_latency_s":1.048268,"redis_calls":13,"redis_duration_s":0.0028380000000000002,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000978,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.00186,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.008993,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.016527,"completed_at":"2026-09-14T09:33:08.958Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1850vm-test-run-nixbot-gitlab> gitlab # [ 314.285976] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.959Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1554e0d871dba79079667bc5","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1554e0d871dba79079667bc5: start","job_status":"start","queue_duration_s":1.065855,"scheduling_latency_s":1.065872}1851vm-test-run-nixbot-gitlab> gitlab # [ 314.298139] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.973Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"1554e0d871dba79079667bc5","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-1554e0d871dba79079667bc5: done: 0.014581 sec","job_status":"done","queue_duration_s":1.065855,"scheduling_latency_s":1.065872,"redis_calls":13,"redis_duration_s":0.002378,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000513,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.001865,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010385,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014581,"completed_at":"2026-09-14T09:33:08.973Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1852vm-test-run-nixbot-gitlab> gitlab # [ 314.336083] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.974Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e1fdbbb6394f77fe53a638e","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e1fdbbb6394f77fe53a638e: start","job_status":"start","queue_duration_s":1.081447,"scheduling_latency_s":1.081463}1853vm-test-run-nixbot-gitlab> gitlab # [ 314.348156] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:08.989Z","retry":0,"queue":"default","version":0,"store":null,"status_expiration":1800,"class":"Ci::UnlockPipelinesInQueueWorker","args":[],"jid":"7e1fdbbb6394f77fe53a638e","created_at":"2026-09-14T09:33:07.818Z","trace_propagation_headers":{"sentry-trace":"c11ff2a001894d2cb6644f4e8ed1f38a-466068d904214230","baggage":"sentry-trace_id=c11ff2a001894d2cb6644f4e8ed1f38a,sentry-release=Unknown"},"meta.caller_id":"Ci::ScheduleUnlockPipelinesInQueueCronWorker","correlation_id":"aa536281344429e4be131d6382fd3feb","meta.root_caller_id":"Cronjob","meta.feature_category":"job_artifacts","meta.client_id":"ip/","worker_data_consistency":"always","worker_data_consistency_per_db":{"main":"always","ci":"always"},"size_limiter":"validated","enqueued_at":"2026-09-14T09:33:07.893Z","job_size_bytes":2,"pid":2033,"sidekiq_tid":"maop","sidekiq_thread_name":"sidekiq.default/processor","message":"Ci::UnlockPipelinesInQueueWorker JID-7e1fdbbb6394f77fe53a638e: done: 0.014731 sec","job_status":"done","queue_duration_s":1.081447,"scheduling_latency_s":1.081463,"redis_calls":13,"redis_duration_s":0.001604,"redis_read_bytes":10,"redis_write_bytes":1157,"redis_queues_metadata_calls":4,"redis_queues_metadata_duration_s":0.000709,"redis_queues_metadata_read_bytes":3,"redis_queues_metadata_write_bytes":359,"redis_shared_state_calls":9,"redis_shared_state_duration_s":0.000895,"redis_shared_state_read_bytes":7,"redis_shared_state_write_bytes":798,"db_count":0,"db_write_count":0,"db_cached_count":0,"db_txn_count":0,"db_replica_txn_count":0,"db_primary_txn_count":0,"db_replica_count":0,"db_primary_count":0,"db_replica_write_count":0,"db_primary_write_count":0,"db_replica_cached_count":0,"db_primary_cached_count":0,"db_replica_wal_count":0,"db_primary_wal_count":0,"db_replica_wal_cached_count":0,"db_primary_wal_cached_count":0,"db_replica_txn_max_duration_s":0.0,"db_primary_txn_max_duration_s":0.0,"db_replica_txn_duration_s":0.0,"db_primary_txn_duration_s":0.0,"db_replica_duration_s":0.0,"db_primary_duration_s":0.0,"db_main_txn_count":0,"db_ci_txn_count":0,"db_main_replica_txn_count":0,"db_ci_replica_txn_count":0,"db_main_count":0,"db_ci_count":0,"db_main_replica_count":0,"db_ci_replica_count":0,"db_main_write_count":0,"db_ci_write_count":0,"db_main_replica_write_count":0,"db_ci_replica_write_count":0,"db_main_cached_count":0,"db_ci_cached_count":0,"db_main_replica_cached_count":0,"db_ci_replica_cached_count":0,"db_main_wal_count":0,"db_ci_wal_count":0,"db_main_replica_wal_count":0,"db_ci_replica_wal_count":0,"db_main_wal_cached_count":0,"db_ci_wal_cached_count":0,"db_main_replica_wal_cached_count":0,"db_ci_replica_wal_cached_count":0,"db_main_txn_max_duration_s":0.0,"db_ci_txn_max_duration_s":0.0,"db_main_replica_txn_max_duration_s":0.0,"db_ci_replica_txn_max_duration_s":0.0,"db_main_txn_duration_s":0.0,"db_ci_txn_duration_s":0.0,"db_main_replica_txn_duration_s":0.0,"db_ci_replica_txn_duration_s":0.0,"db_main_duration_s":0.0,"db_ci_duration_s":0.0,"db_main_replica_duration_s":0.0,"db_ci_replica_duration_s":0.0,"cpu_s":0.010408,"worker_id":"sidekiq_0","rate_limiting_gates":[],"exclusive_lock_requested_count":1,"exclusive_lock_wait_duration_s":0,"exclusive_lock_hold_duration_s":0,"extra.ci_unlock_pipelines_in_queue_worker.remaining_pending":0,"duration_s":0.014731,"completed_at":"2026-09-14T09:33:08.989Z","load_balancing_strategy":"primary","db_duration_s":0.0,"urgency":"low","target_duration_s":300,"target_scheduling_latency_s":60}1854vm-test-run-nixbot-gitlab> gitlab # [ 315.020389] postgres[3292]: [3292] ERROR: relation "table_without_models" does not exist1855vm-test-run-nixbot-gitlab> gitlab # [ 315.020626] postgres[3292]: [3292] STATEMENT: SELECT pg_get_serial_sequence('table_without_models', 'id')1856vm-test-run-nixbot-gitlab> gitlab # [ 320.821608] runuser[2956]: pam_unix(runuser:session): session closed for user gitlab1857vm-test-run-nixbot-gitlab> gitlab # [ 320.823476] setup-gitlab-start[2927]: + systemctl restart gitlab-sidekiq.service1858vm-test-run-nixbot-gitlab> gitlab # [ 320.856789] systemd[1]: Stopping gitlab-sidekiq.service...1859vm-test-run-nixbot-gitlab> gitlab # [ 320.860321] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:17.695Z","message":"Shutting down"}1860vm-test-run-nixbot-gitlab> gitlab # [ 320.864260] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:17.695Z","message":"Scheduler exiting..."}1861vm-test-run-nixbot-gitlab> gitlab # [ 320.868433] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:17.696Z","message":"Terminating quiet threads for default capsule"}1862vm-test-run-nixbot-gitlab> gitlab # [ 320.873385] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:17.697Z","message":"Scheduler exiting..."}1863vm-test-run-nixbot-gitlab> gitlab # [ 321.361341] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:18.197Z","message":"Pausing to allow jobs to finish..."}1864vm-test-run-nixbot-gitlab> gitlab # [ 322.365858] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:19.201Z","message":"Bye!"}1865vm-test-run-nixbot-gitlab> gitlab # [ 322.410535] sidekiq-cluster[2033]: {"severity":"INFO","time":"2026-09-14T09:33:19.247Z","message":"stopped","memwd_reason":"background task stopped","memwd_handler_class":"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler","memwd_sleep_time_s":3,"pid":2033,"worker_id":"sidekiq_0","memwd_rss_bytes":928247808,"retry":0}1866vm-test-run-nixbot-gitlab> gitlab # [ 324.789405] systemd[1]: gitlab-sidekiq.service: Deactivated successfully.1867vm-test-run-nixbot-gitlab> gitlab # [ 324.789879] systemd[1]: Stopped gitlab-sidekiq.service.1868vm-test-run-nixbot-gitlab> gitlab # [ 324.790110] systemd[1]: gitlab-sidekiq.service: Consumed 1min 54.089s CPU time over 3min 20.294s wall clock time, 936.8M memory peak, 4.5M read from disk.1869vm-test-run-nixbot-gitlab> gitlab # [ 324.804590] systemd[1]: Started gitlab-sidekiq.service.1870vm-test-run-nixbot-gitlab> gitlab # [ 324.808074] setup-gitlab-start[2927]: + mkdir -p /var/lib/secrets1871vm-test-run-nixbot-gitlab> gitlab # [ 324.812989] setup-gitlab-start[2927]: + echo nixbot-test-token-of-20-chars1872vm-test-run-nixbot-gitlab> gitlab # [ 324.815983] setup-gitlab-start[2927]: + chmod 644 /var/lib/secrets/gitlab-token1873vm-test-run-nixbot-gitlab> gitlab # [ 324.818982] setup-gitlab-start[2927]: + timeout 300 bash -c $'until curl -fs -H "PRIVATE-TOKEN: $0" http://gitlab/api/v4/projects/root%2Ftest-flake > /dev/null; do\n curl -s -X POST -H "PRIVATE-TOKEN: $0" -H "Content-Type: application/json" \\\n -d "{\\"name\\":\\"test-flake\\",\\"visibility\\":\\"public\\",\\"topics\\":[\\"build-with-buildbot\\"]}" \\\n http://gitlab/api/v4/projects | jq -c "{id, message, error}"\n sleep 5\ndone' nixbot-test-token-of-20-chars1874vm-test-run-nixbot-gitlab> gitlab # [ 325.421572] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:22 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 404 35 "" "curl/8.21.0" 5541875vm-test-run-nixbot-gitlab> gitlab # [ 326.762727] gitaly[912]: time="2026-09-14T09:33:23.598Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:33:33.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:23.597" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1876vm-test-run-nixbot-gitlab> gitlab # [ 326.792885] gitaly[912]: time="2026-09-14T09:33:23.598Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:33:33.005" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=95 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:23.597" grpc.time_ms=0.931 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1877vm-test-run-nixbot-gitlab> gitlab # [ 327.061211] gitaly[912]: time="2026-09-14T09:33:23.898Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:33:33.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:23.897" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1878vm-test-run-nixbot-gitlab> gitlab # [ 327.100710] gitaly[912]: time="2026-09-14T09:33:23.898Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:33:33.006" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:23.897" grpc.time_ms=0.545 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1879vm-test-run-nixbot-gitlab> gitlab # [ 327.149766] gitaly[912]: time="2026-09-14T09:33:23.986Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 diskcache=8e9b5439-0fac-41fc-b9ed-0f0965a9ff0f grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-14T09:33:33.027" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:23.918" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1880vm-test-run-nixbot-gitlab> gitlab # [ 327.179214] gitaly[912]: time="2026-09-14T09:33:23.987Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=34 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1437 command.oublock=32 command.real_time_ms=47 command.spawn_token_fork_ms=12 command.system_time_ms=31 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-14T09:33:33.027" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:23.918" grpc.time_ms=68.643 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1881vm-test-run-nixbot-gitlab> gitlab # [ 327.208185] gitaly[912]: time="2026-09-14T09:33:24.005Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:33:34.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:24.004" pid=912 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1882vm-test-run-nixbot-gitlab> gitlab # [ 327.228676] gitaly[912]: time="2026-09-14T09:33:24.006Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:33:34.003" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:24.004" grpc.time_ms=1.738 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1883vm-test-run-nixbot-gitlab> gitlab # [ 327.245473] gitaly[912]: time="2026-09-14T09:33:24.025Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=573 command.oublock=0 command.real_time_ms=10 command.spawn_token_fork_ms=2 command.system_time_ms=8 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:33:34.011" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:24.012" grpc.time_ms=12.335 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1884vm-test-run-nixbot-gitlab> gitlab # [ 327.280780] gitaly[912]: time="2026-09-14T09:33:24.117Z" level=error msg="housekeeping: find repo path" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 error="repository not found" grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:33:34.116" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:24.116" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1885vm-test-run-nixbot-gitlab> gitlab # [ 327.300493] gitaly[912]: time="2026-09-14T09:33:24.118Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:33:34.116" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:24.116" grpc.time_ms=0.954 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1886vm-test-run-nixbot-gitlab> gitlab # [ 327.330645] gitaly[912]: time="2026-09-14T09:33:24.167Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 diskcache=1795a745-1162-40c0-9918-c057dfab06b1 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-14T09:33:34.120" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:24.121" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1887vm-test-run-nixbot-gitlab> gitlab # [ 327.361304] gitaly[912]: time="2026-09-14T09:33:24.167Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1435 command.oublock=32 command.real_time_ms=24 command.spawn_token_fork_ms=4 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CreateRepository grpc.request.deadline="2026-09-14T09:33:34.120" grpc.request.fullMethod=/gitaly.RepositoryService/CreateRepository grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=137 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:24.121" grpc.time_ms=46.209 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1888vm-test-run-nixbot-gitlab> gitlab # [ 327.391790] gitaly[912]: time="2026-09-14T09:33:24.174Z" level=info msg="collected repository statistics" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:33:34.172" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:24.173" pid=912 remote_ip="2001:db8:1::1" repository_stats="map[directory_count:7 file_count:3]" span.kind=server system=grpc username=root1889vm-test-run-nixbot-gitlab> gitlab # [ 327.413269] gitaly[912]: time="2026-09-14T09:33:24.174Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:33:34.172" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:24.173" grpc.time_ms=0.772 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1890vm-test-run-nixbot-gitlab> gitlab # [ 327.433114] gitaly[912]: time="2026-09-14T09:33:24.186Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=4 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=6 command.spawn_token_fork_ms=0 command.system_time_ms=0 command.user_time_ms=4 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:33:34.177" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake.wiki grpc.request.glRepository=wiki-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.wiki.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:24.178" grpc.time_ms=7.645 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1891vm-test-run-nixbot-gitlab> gitlab # [ 327.452798] gitaly[912]: time="2026-09-14T09:33:24.222Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RepositoryExists grpc.request.deadline="2026-09-14T09:33:34.220" grpc.request.fullMethod=/gitaly.RepositoryService/RepositoryExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:24.221" grpc.time_ms=0.416 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1892vm-test-run-nixbot-gitlab> gitlab # [ 327.467772] gitaly[912]: time="2026-09-14T09:33:24.230Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-14T09:33:34.229" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:24.229" grpc.time_ms=0.338 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1893vm-test-run-nixbot-gitlab> gitlab # [ 328.038070] gitaly[912]: time="2026-09-14T09:33:24.873Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=7 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM75Z1ANQV8NAAG23KA092 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:33:34.265" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:24.856" grpc.time_ms=17.162 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1894vm-test-run-nixbot-gitlab> gitlab # [ 328.485109] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:25 +0000] "POST /api/v4/projects HTTP/1.1" 201 4828 "" "curl/8.21.0" 30431895vm-test-run-nixbot-gitlab> gitlab # [ 328.491280] setup-gitlab-start[3372]: {"id":1,"message":null,"error":null}1896vm-test-run-nixbot-gitlab> gitlab # [ 329.951026] sidekiq-cluster[3355]: {"severity":"INFO","time":"2026-09-14T09:33:26.757Z","message":"Starting cluster with 1 processes"}1897vm-test-run-nixbot-gitlab> gitlab # [ 334.294646] gitaly[912]: time="2026-09-14T09:33:31.130Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=4 command.user_time_ms=7 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7DVNG8JW8WD4GABKMSYG grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:33:41.006" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:31.116" grpc.time_ms=13.242 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1898vm-test-run-nixbot-gitlab> gitlab # [ 334.876715] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:31 +0000] "GET /api/v4/projects/root%2Ftest-flake HTTP/1.1" 200 4924 "" "curl/8.21.0" 13541899vm-test-run-nixbot-gitlab> gitlab # [ 334.883632] setup-gitlab-start[2927]: + mkdir -p /tmp/test-flake1900vm-test-run-nixbot-gitlab> gitlab # [ 334.886412] setup-gitlab-start[2927]: + cd /tmp/test-flake1901vm-test-run-nixbot-gitlab> gitlab # [ 334.889049] setup-gitlab-start[2927]: + git init -b master1902vm-test-run-nixbot-gitlab> gitlab # [ 334.898511] setup-gitlab-start[3462]: Initialized empty Git repository in /tmp/test-flake/.git/1903vm-test-run-nixbot-gitlab> gitlab # [ 334.902182] setup-gitlab-start[2927]: + git config user.name test1904vm-test-run-nixbot-gitlab> gitlab # [ 334.904770] setup-gitlab-start[2927]: + git config user.email test@example.com1905vm-test-run-nixbot-gitlab> gitlab # [ 334.907619] setup-gitlab-start[2927]: + cat1906vm-test-run-nixbot-gitlab> gitlab # [ 334.909446] setup-gitlab-start[2927]: + git add flake.nix1907vm-test-run-nixbot-gitlab> gitlab # [ 334.911712] setup-gitlab-start[2927]: + git commit -m 'initial commit'1908vm-test-run-nixbot-gitlab> gitlab # [ 334.935933] setup-gitlab-start[3467]: [master (root-commit) 31d0076] initial commit1909vm-test-run-nixbot-gitlab> gitlab # [ 334.940322] setup-gitlab-start[3467]: 1 file changed, 10 insertions(+)1910vm-test-run-nixbot-gitlab> gitlab # [ 334.943234] setup-gitlab-start[3467]: create mode 100644 flake.nix1911vm-test-run-nixbot-gitlab> gitlab # [ 334.946036] setup-gitlab-start[2927]: + git remote add origin http://oauth2:nixbot-test-token-of-20-chars@gitlab/root/test-flake.git1912vm-test-run-nixbot-gitlab> gitlab # [ 334.951850] setup-gitlab-start[2927]: + git push -u origin master1913vm-test-run-nixbot-gitlab> gitlab # [ 335.057736] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:31 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 401 343 "" "git/2.55.0" 631914vm-test-run-nixbot-gitlab> gitlab # [ 335.287512] gitaly[912]: time="2026-09-14T09:33:32.124Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=581 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=1 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FM7FBX9DKCT9875MH6GHB2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=244 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:32.108" grpc.time_ms=15.7 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1915vm-test-run-nixbot-gitlab> gitlab # [ 335.325350] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:32 +0000] "GET /root/test-flake.git/info/refs?service=git-receive-pack HTTP/1.1" 200 178 "" "git/2.55.0" 2251916vm-test-run-nixbot-gitlab> gitlab # [ 335.675479] gitaly[912]: time="2026-09-14T09:33:32.511Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=9 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:33:42.003" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=169 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:32.494" grpc.time_ms=17.415 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1917vm-test-run-nixbot-gitlab> gitlab # [ 335.761514] gitaly[912]: time="2026-09-14T09:33:32.598Z" level=info msg="finished streaming call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 command.count=1 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=302 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListAllLFSPointers grpc.request.deadline="2026-09-14T09:34:02.079" grpc.request.fullMethod=/gitaly.BlobService/ListAllLFSPointers grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=163 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.BlobService grpc.start_time="2026-09-14T09:33:32.580" grpc.time_ms=17.911 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1918vm-test-run-nixbot-gitlab> gitlab # [ 335.813778] gitaly[912]: time="2026-09-14T09:33:32.650Z" level=info msg="Finished HTTP request" content_length_bytes=853 correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ duration_ms=284ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/allowed"1919vm-test-run-nixbot-gitlab> gitlab # [ 335.871796] gitaly[912]: time="2026-09-14T09:33:32.708Z" level=info msg="Finished HTTP request" content_length_bytes=36 correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ duration_ms=56ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/pre_receive"1920vm-test-run-nixbot-gitlab> gitlab # [ 335.885270] gitaly[912]: time="2026-09-14T09:33:32.709Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PreReceiveHook grpc.request.fullMethod=/gitaly.HookService/PreReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=5316 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:33:32.363" grpc.time_ms=345.628 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1921vm-test-run-nixbot-gitlab> gitlab # [ 335.974953] gitaly[912]: time="2026-09-14T09:33:32.811Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=UpdateHook grpc.request.fullMethod=/gitaly.HookService/UpdateHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4786 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:33:32.810" grpc.time_ms=1.51 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1922vm-test-run-nixbot-gitlab> gitlab # [ 336.045170] gitaly[912]: time="2026-09-14T09:33:32.882Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4785 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:33:32.880" grpc.time_ms=1.301 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1923vm-test-run-nixbot-gitlab> gitlab # [ 336.097901] gitaly[912]: time="2026-09-14T09:33:32.934Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4787 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:33:32.933" grpc.time_ms=0.933 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1924vm-test-run-nixbot-gitlab> gitlab # [ 336.242848] gitaly[912]: time="2026-09-14T09:33:33.079Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=HasLocalBranches grpc.request.deadline="2026-09-14T09:33:43.062" grpc.request.fullMethod=/gitaly.RepositoryService/HasLocalBranches grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:33.063" grpc.time_ms=15.892 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1925vm-test-run-nixbot-gitlab> gitlab # [ 336.281748] gitaly[912]: time="2026-09-14T09:33:33.118Z" level=info msg="finished unary call with code OK" command.count=5 command.cpu_time_ms=18 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1432 command.oublock=0 command.real_time_ms=22 command.spawn_token_fork_ms=5 command.system_time_ms=18 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindDefaultBranchName grpc.request.deadline="2026-09-14T09:33:43.088" grpc.request.fullMethod=/gitaly.RefService/FindDefaultBranchName grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=19 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:33:33.089" grpc.time_ms=28.212 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root1926vm-test-run-nixbot-gitlab> gitlab # [ 336.308673] gitaly[912]: time="2026-09-14T09:33:33.133Z" level=info msg="Finished HTTP request" content_length_bytes=50 correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ duration_ms=152ns method=POST pid=912 status=200 url="http://unix/api/v4/internal/post_receive"1927vm-test-run-nixbot-gitlab> gitlab # [ 336.313462] gitaly[912]: time="2026-09-14T09:33:33.134Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceiveHook grpc.request.fullMethod=/gitaly.HookService/PostReceiveHook grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=4810 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:33:32.979" grpc.time_ms=155.509 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1928vm-test-run-nixbot-gitlab> gitlab # [ 336.330190] gitaly[912]: time="2026-09-14T09:33:33.146Z" level=info msg="diskcache state change" component=gitaly.StreamServerInterceptor correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ diskcache=04380750-9e29-46af-9261-8e0bd5974369 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:32.250" pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1929vm-test-run-nixbot-gitlab> gitlab # [ 336.346852] systemd[1]: Finished setup-gitlab.service.1930vm-test-run-nixbot-gitlab> gitlab # [ 336.348517] gitlab-workhorse[819]: time="2026-09-14T09:33:33Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-receive-pack written_bytes=521931vm-test-run-nixbot-gitlab> gitlab # [ 336.351217] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:33 +0000] "POST /root/test-flake.git/git-receive-pack HTTP/1.1" 200 52 "" "git/2.55.0" 10011932vm-test-run-nixbot-gitlab> gitlab # [ 336.354184] setup-gitlab-start[3471]: To http://gitlab/root/test-flake.git1933vm-test-run-nixbot-gitlab> gitlab # [ 336.355443] setup-gitlab-start[3471]: * [new branch] master -> master1934vm-test-run-nixbot-gitlab> gitlab # [ 336.356714] setup-gitlab-start[3471]: branch 'master' set up to track 'origin/master'.1935vm-test-run-nixbot-gitlab> gitlab # [ 336.358094] gitaly[912]: time="2026-09-14T09:33:33.147Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=355 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=847872 command.minflt=13769 command.oublock=32 command.real_time_ms=888 command.spawn_token_fork_ms=2 command.system_time_ms=186 command.user_time_ms=169 component=gitaly.StreamServerInterceptor correlation_id=01M2FM7FKJVDF7DSR6Z9GNEAVJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=PostReceivePack grpc.request.fullMethod=/gitaly.SmartHTTPService/PostReceivePack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=684 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=58 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:32.250" grpc.time_ms=896.448 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc user_id=user-1 username=root1936vm-test-run-nixbot-gitlab> gitlab # [ 336.374643] systemd[1]: Starting nixbot CI service...1937vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit setup-gitlab.service, in 337.27 seconds)1938vm-test-run-nixbot-gitlab> gitlab: waiting for unit nixbot.service1939vm-test-run-nixbot-gitlab> gitlab # [ 337.689868] nixbot[3549]: {"ts": "2026-09-14T09:33:34.525Z", "level": "info", "logger": "nixbot.main", "msg": "nixbot starting", "url": "http://localhost:8010", "state_dir": "/var/lib/nixbot"}1940vm-test-run-nixbot-gitlab> gitlab # [ 337.717177] nixbot[3549]: {"ts": "2026-09-14T09:33:34.553Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 1, "migration": "initial"}1941vm-test-run-nixbot-gitlab> gitlab # [ 337.760720] nixbot[3549]: {"ts": "2026-09-14T09:33:34.597Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 2, "migration": "scheduled_effects"}1942vm-test-run-nixbot-gitlab> gitlab # [ 337.769606] nixbot[3549]: {"ts": "2026-09-14T09:33:34.606Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 3, "migration": "gitea_webhook_secrets"}1943vm-test-run-nixbot-gitlab> gitlab # [ 337.777351] nixbot[3549]: {"ts": "2026-09-14T09:33:34.614Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 4, "migration": "api_tokens"}1944vm-test-run-nixbot-gitlab> gitlab # [ 337.789480] nixbot[3549]: {"ts": "2026-09-14T09:33:34.626Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 5, "migration": "status_notify"}1945vm-test-run-nixbot-gitlab> gitlab # [ 337.796768] nixbot[3549]: {"ts": "2026-09-14T09:33:34.633Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 6, "migration": "webhook_secrets"}1946vm-test-run-nixbot-gitlab> gitlab # [ 337.800869] nixbot[3549]: {"ts": "2026-09-14T09:33:34.636Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 7, "migration": "build_effects"}1947vm-test-run-nixbot-gitlab> gitlab # [ 337.811213] nixbot[3549]: {"ts": "2026-09-14T09:33:34.648Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 8, "migration": "api_token_groups"}1948vm-test-run-nixbot-gitlab> gitlab # [ 337.815665] nixbot[3549]: {"ts": "2026-09-14T09:33:34.651Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 9, "migration": "scheduled_effect_runs"}1949vm-test-run-nixbot-gitlab> gitlab # [ 337.824428] nixbot[3549]: {"ts": "2026-09-14T09:33:34.661Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 10, "migration": "work_queue"}1950vm-test-run-nixbot-gitlab> gitlab # [ 337.835208] nixbot[3549]: {"ts": "2026-09-14T09:33:34.672Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 11, "migration": "revoked_sessions"}1951vm-test-run-nixbot-gitlab> gitlab # [ 337.841079] nixbot[3549]: {"ts": "2026-09-14T09:33:34.677Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 12, "migration": "truncate_notify_names"}1952vm-test-run-nixbot-gitlab> gitlab # [ 337.845983] nixbot[3549]: {"ts": "2026-09-14T09:33:34.682Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 13, "migration": "failed_builds_per_project"}1953vm-test-run-nixbot-gitlab> gitlab # [ 337.856272] nixbot[3549]: {"ts": "2026-09-14T09:33:34.689Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 14, "migration": "streamed_eval_warnings"}1954vm-test-run-nixbot-gitlab> gitlab # [ 337.861062] nixbot[3549]: {"ts": "2026-09-14T09:33:34.693Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 15, "migration": "eval_completed"}1955vm-test-run-nixbot-gitlab> gitlab # [ 337.865279] nixbot[3549]: {"ts": "2026-09-14T09:33:34.696Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 16, "migration": "reconcile_watermark"}1956vm-test-run-nixbot-gitlab> gitlab # [ 337.870906] nixbot[3549]: {"ts": "2026-09-14T09:33:34.698Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 17, "migration": "check_runs"}1957vm-test-run-nixbot-gitlab> gitlab # [ 337.875340] nixbot[3549]: {"ts": "2026-09-14T09:33:34.706Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 18, "migration": "effects_commit"}1958vm-test-run-nixbot-gitlab> gitlab # [ 337.879804] nixbot[3549]: {"ts": "2026-09-14T09:33:34.709Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 19, "migration": "scheduled_run_notify"}1959vm-test-run-nixbot-gitlab> gitlab # [ 337.884371] nixbot[3549]: {"ts": "2026-09-14T09:33:34.713Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 20, "migration": "log_metadata"}1960vm-test-run-nixbot-gitlab> gitlab # [ 337.888369] nixbot[3549]: {"ts": "2026-09-14T09:33:34.721Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 21, "migration": "forge_refresh_tokens"}1961vm-test-run-nixbot-gitlab> gitlab # [ 337.893390] nixbot[3549]: {"ts": "2026-09-14T09:33:34.723Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 22, "migration": "attr_finished_idx"}1962vm-test-run-nixbot-gitlab> gitlab # [ 337.897728] nixbot[3549]: {"ts": "2026-09-14T09:33:34.726Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 23, "migration": "effect_deps"}1963vm-test-run-nixbot-gitlab> gitlab # [ 337.901822] nixbot[3549]: {"ts": "2026-09-14T09:33:34.728Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 24, "migration": "drop_forge_tokens"}1964vm-test-run-nixbot-gitlab> gitlab # [ 337.905630] nixbot[3549]: {"ts": "2026-09-14T09:33:34.732Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 25, "migration": "effect_skipped_rename"}1965vm-test-run-nixbot-gitlab> gitlab # [ 337.909356] nixbot[3549]: {"ts": "2026-09-14T09:33:34.734Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 26, "migration": "attr_eval_warnings"}1966vm-test-run-nixbot-gitlab> gitlab # [ 337.912802] nixbot[3549]: {"ts": "2026-09-14T09:33:34.736Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 27, "migration": "eval_stats"}1967vm-test-run-nixbot-gitlab> gitlab # [ 337.915994] nixbot[3549]: {"ts": "2026-09-14T09:33:34.738Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 28, "migration": "effect_runs"}1968vm-test-run-nixbot-gitlab> gitlab # [ 337.919083] nixbot[3549]: {"ts": "2026-09-14T09:33:34.755Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 29, "migration": "event_effects"}1969vm-test-run-nixbot-gitlab> gitlab # [ 337.923994] nixbot[3549]: {"ts": "2026-09-14T09:33:34.760Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 30, "migration": "work_retry"}1970vm-test-run-nixbot-gitlab> gitlab # [ 337.927408] nixbot[3549]: {"ts": "2026-09-14T09:33:34.763Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 31, "migration": "merged_pr_number"}1971vm-test-run-nixbot-gitlab> gitlab # [ 337.930976] nixbot[3549]: {"ts": "2026-09-14T09:33:34.764Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 32, "migration": "upload_queue"}1972vm-test-run-nixbot-gitlab> gitlab # [ 337.934627] nixbot[3549]: {"ts": "2026-09-14T09:33:34.769Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 33, "migration": "effect_runs_catchup"}1973vm-test-run-nixbot-gitlab> gitlab # [ 337.938159] nixbot[3549]: {"ts": "2026-09-14T09:33:34.772Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 34, "migration": "public_badges"}1974vm-test-run-nixbot-gitlab> gitlab # [ 337.942123] nixbot[3549]: {"ts": "2026-09-14T09:33:34.778Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 35, "migration": "settle_reset_effects"}1975vm-test-run-nixbot-gitlab> gitlab # [ 337.945604] nixbot[3549]: {"ts": "2026-09-14T09:33:34.782Z", "level": "info", "logger": "nixbot.migrations", "msg": "applying migration", "version": 36, "migration": "pr_approvals"}1976vm-test-run-nixbot-gitlab> gitlab # [ 338.341115] nixbot[3549]: INFO: Started server process [3549]1977vm-test-run-nixbot-gitlab> gitlab # [ 338.343823] nixbot[3549]: INFO: Uvicorn running on socket ('::', 8010, 0, 0) (Press CTRL+C to quit)1978vm-test-run-nixbot-gitlab> gitlab # [ 338.365330] nixbot[3549]: INFO: ::ffff:127.0.0.1:37046 - "GET /health HTTP/1.1" 200 OK1979vm-test-run-nixbot-gitlab> gitlab # [ 338.373090] systemd[1]: Started nixbot CI service.1980vm-test-run-nixbot-gitlab> gitlab # [ 338.379507] systemd[1]: Reached target Multi-User System.1981vm-test-run-nixbot-gitlab> gitlab # [ 338.383955] systemd[1]: Startup finished in 813ms (kernel) + 4.230s (initrd) + 5min 33.339s (userspace) = 5min 38.383s.1982vm-test-run-nixbot-gitlab> gitlab # [ 338.938394] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:35 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 5731983vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for unit nixbot.service, in 2.15 seconds)1984vm-test-run-nixbot-gitlab> gitlab: waiting for success: curl --fail -s http://127.0.0.1:8010/health1985vm-test-run-nixbot-gitlab> gitlab # [ 338.948688] nixbot[3549]: {"ts": "2026-09-14T09:33:35.774Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}1986vm-test-run-nixbot-gitlab> gitlab # [ 338.964138] nixbot[3549]: {"ts": "2026-09-14T09:33:35.798Z", "level": "info", "logger": "nixbot.repos", "msg": "legacy topic import complete", "topics": {"gitlab": "build-with-buildbot"}, "enabled": 1}1987vm-test-run-nixbot-gitlab> gitlab # [ 338.999658] nixbot[3549]: INFO: ::ffff:127.0.0.1:37052 - "GET /health HTTP/1.1" 200 OK1988vm-test-run-nixbot-gitlab> gitlab: (finished: waiting for success: curl --fail -s http://127.0.0.1:8010/health, in 0.05 seconds)1989vm-test-run-nixbot-gitlab> subtest: project discovered and webhook registered1990vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks1991vm-test-run-nixbot-gitlab> gitlab # [ 339.180196] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "curl/8.21.0" 1251992vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.18 seconds)1993vm-test-run-nixbot-gitlab> gitlab # [ 339.237297] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 2641994vm-test-run-nixbot-gitlab> gitlab # [ 339.239773] nixbot[3549]: {"ts": "2026-09-14T09:33:36.076Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}1995vm-test-run-nixbot-gitlab> gitlab # [ 339.243746] nixbot[3549]: {"ts": "2026-09-14T09:33:36.080Z", "level": "info", "logger": "nixbot.hook_registration", "msg": "registering webhook", "repo": "root/test-flake"}1996vm-test-run-nixbot-gitlab> gitlab # [ 339.394535] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:36 +0000] "POST /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 201 918 "" "python-httpx/0.28.1" 1441997vm-test-run-nixbot-gitlab> gitlab # [ 339.401326] nixbot[3549]: {"ts": "2026-09-14T09:33:36.233Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 201 Created\""}1998vm-test-run-nixbot-gitlab> gitlab # [ 339.767980] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:36 +0000] "GET /api/v4/projects?membership=true&archived=false&per_page=100 HTTP/1.1" 200 4909 "" "python-httpx/0.28.1" 3581999vm-test-run-nixbot-gitlab> gitlab # [ 339.770382] nixbot[3549]: {"ts": "2026-09-14T09:33:36.607Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects?membership=true&archived=false&per_page=100 \"HTTP/1.1 200 OK\""}2000vm-test-run-nixbot-gitlab> gitlab # [ 339.850753] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "python-httpx/0.28.1" 642001vm-test-run-nixbot-gitlab> gitlab # [ 339.857487] nixbot[3549]: {"ts": "2026-09-14T09:33:36.688Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/hooks \"HTTP/1.1 200 OK\""}2002vm-test-run-nixbot-gitlab> gitlab # [ 339.934139] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:36 +0000] "PUT /api/v4/projects/root%2Ftest-flake/hooks/1 HTTP/1.1" 200 918 "" "python-httpx/0.28.1" 782003vm-test-run-nixbot-gitlab> gitlab # [ 339.940568] nixbot[3549]: {"ts": "2026-09-14T09:33:36.771Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: PUT http://gitlab/api/v4/projects/root%2Ftest-flake/hooks/1 \"HTTP/1.1 200 OK\""}2004vm-test-run-nixbot-gitlab> gitlab # [ 340.032396] gitaly[912]: time="2026-09-14T09:33:36.867Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=575 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=3 command.system_time_ms=10 command.user_time_ms=3 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7M48BZH2CBZQF4HPG9H7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindBranch grpc.request.deadline="2026-09-14T09:34:06.039" grpc.request.fullMethod=/gitaly.RefService/FindBranch grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=215 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:33:36.840" grpc.time_ms=26.545 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2005vm-test-run-nixbot-gitlab> gitlab # [ 340.076822] gitaly[912]: time="2026-09-14T09:33:36.913Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7M48BZH2CBZQF4HPG9H7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:34:06.111" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=131 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:33:36.912" grpc.time_ms=1.183 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2006vm-test-run-nixbot-gitlab> gitlab # [ 340.105408] gitaly[912]: time="2026-09-14T09:33:36.935Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7M48BZH2CBZQF4HPG9H7 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=CommitIsAncestor grpc.request.deadline="2026-09-14T09:33:46.009" grpc.request.fullMethod=/gitaly.CommitService/CommitIsAncestor grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=207 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:33:36.919" grpc.time_ms=15.177 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2007vm-test-run-nixbot-gitlab> gitlab # [ 340.143291] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:36 +0000] "GET /api/v4/projects/root%2Ftest-flake/repository/branches/master HTTP/1.1" 200 732 "" "python-httpx/0.28.1" 2022008vm-test-run-nixbot-gitlab> gitlab # [ 340.148720] nixbot[3549]: {"ts": "2026-09-14T09:33:36.981Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/repository/branches/master \"HTTP/1.1 200 OK\""}2009vm-test-run-nixbot-gitlab> gitlab: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks2010vm-test-run-nixbot-gitlab> gitlab # [ 340.267655] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 HTTP/1.1" 200 2 "" "python-httpx/0.28.1" 1192011vm-test-run-nixbot-gitlab> gitlab # [ 340.270594] nixbot[3549]: {"ts": "2026-09-14T09:33:37.107Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: GET http://gitlab/api/v4/projects/root%2Ftest-flake/merge_requests?state=opened&per_page=100 \"HTTP/1.1 200 OK\""}2012vm-test-run-nixbot-gitlab> gitlab # [ 340.278722] nixbot[3549]: {"ts": "2026-09-14T09:33:37.115Z", "level": "info", "logger": "nixbot.reconcile", "msg": "reconciliation: building unbuilt head", "project": "root/test-flake", "branch": "master", "pr": null}2013vm-test-run-nixbot-gitlab> gitlab # [ 340.331801] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:37 +0000] "GET /api/v4/projects/root%2Ftest-flake/hooks HTTP/1.1" 200 881 "" "curl/8.21.0" 912014vm-test-run-nixbot-gitlab> gitlab: (finished: must succeed: TOKEN=$(cat /var/lib/secrets/gitlab-token); curl -fs -H "PRIVATE-TOKEN: $TOKEN" http://gitlab/api/v4/projects/root%2Ftest-flake/hooks, in 0.15 seconds)2015vm-test-run-nixbot-gitlab> (finished: subtest: project discovered and webhook registered, in 1.33 seconds)2016vm-test-run-nixbot-gitlab> subtest: push delivers the webhook2017vm-test-run-nixbot-gitlab> gitlab: waiting for success: journalctl -u gitlab-sidekiq _SYSTEMD_INVOCATION_ID=$(systemctl show -P InvocationID gitlab-sidekiq) | grep -q 'Booted Rails'2018vm-test-run-nixbot-gitlab> gitlab # [ 340.457561] gitaly[912]: time="2026-09-14T09:33:37.294Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=579 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=7 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M2FM7MH87T3S5NBJQGNVNAN9 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:37.278" grpc.time_ms=15.31 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2019vm-test-run-nixbot-gitlab> gitlab # [ 340.494989] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:37 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1042020vm-test-run-nixbot-gitlab> gitlab # [ 340.648499] gitaly[912]: time="2026-09-14T09:33:37.485Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7MMKTMWPTHA9JX78JT7D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:37.468" pid=912 remote_ip="2001:db8:1::1" request_sha=cbf4cb85c7b4a4aa26c72509fcce4a61c2433abb response_bytes=113 span.kind=server system=grpc2021vm-test-run-nixbot-gitlab> gitlab # [ 340.679639] gitaly[912]: time="2026-09-14T09:33:37.485Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7MMKTMWPTHA9JX78JT7D grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:37.468" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2022vm-test-run-nixbot-gitlab> gitlab # [ 340.709813] gitlab-workhorse[819]: time="2026-09-14T09:33:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=1132023vm-test-run-nixbot-gitlab> gitlab # [ 340.713245] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 113 "" "git/2.55.0" 1872024vm-test-run-nixbot-gitlab> gitlab # [ 340.716467] gitaly[912]: time="2026-09-14T09:33:37.486Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=1 command.system_time_ms=11 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7MMKTMWPTHA9JX78JT7D grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:37.468" grpc.time_ms=16.728 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2025vm-test-run-nixbot-gitlab> gitlab # [ 340.743828] gitaly[912]: time="2026-09-14T09:33:37.580Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7MTJ69D6FG4SSQ8B4BV0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:37.553" pid=912 remote_ip="2001:db8:1::1" request_sha=11c95ac3a67b6e463fd9eff52985a73d45e0a93d response_bytes=223 span.kind=server system=grpc2026vm-test-run-nixbot-gitlab> gitlab # [ 340.763291] gitaly[912]: time="2026-09-14T09:33:37.580Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7MTJ69D6FG4SSQ8B4BV0 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:37.553" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2027vm-test-run-nixbot-gitlab> gitlab # [ 340.788143] gitlab-workhorse[819]: time="2026-09-14T09:33:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2232028vm-test-run-nixbot-gitlab> gitlab # [ 340.791124] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 223 "" "git/2.55.0" 902029vm-test-run-nixbot-gitlab> gitlab # [ 340.794206] gitaly[912]: time="2026-09-14T09:33:37.581Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=21 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1136 command.oublock=0 command.real_time_ms=23 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7MTJ69D6FG4SSQ8B4BV0 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:37.553" grpc.time_ms=27.276 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2030vm-test-run-nixbot-gitlab> gitlab # [ 340.897364] gitaly[912]: time="2026-09-14T09:33:37.734Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=2 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FM7MZAJ6VW3ZXMHDNE5070 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:37.715" grpc.time_ms=18.711 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2031vm-test-run-nixbot-gitlab> gitlab # [ 340.936300] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:37 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 922032vm-test-run-nixbot-gitlab> gitlab # [ 340.993402] gitaly[912]: time="2026-09-14T09:33:37.830Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7N29HPHKWBMX72BD874W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:37.811" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2033vm-test-run-nixbot-gitlab> gitlab # [ 341.022738] gitaly[912]: time="2026-09-14T09:33:37.830Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7N29HPHKWBMX72BD874W grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:37.811" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2034vm-test-run-nixbot-gitlab> gitlab # [ 341.048739] gitlab-workhorse[819]: time="2026-09-14T09:33:37Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672035vm-test-run-nixbot-gitlab> gitlab # [ 341.051710] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:37 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 942036vm-test-run-nixbot-gitlab> gitlab # [ 341.055292] gitaly[912]: time="2026-09-14T09:33:37.830Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=583 command.oublock=0 command.real_time_ms=14 command.spawn_token_fork_ms=0 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7N29HPHKWBMX72BD874W grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:37.811" grpc.time_ms=18.74 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2037vm-test-run-nixbot-gitlab> gitlab # [ 341.163907] gitaly[912]: time="2026-09-14T09:33:38.000Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=11 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=578 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=9 command.system_time_ms=4 command.user_time_ms=7 component=gitaly.StreamServerInterceptor correlation_id=01M2FM7N7K45D1PGZHQ47KVTQV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:37.981" grpc.time_ms=18.473 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2038vm-test-run-nixbot-gitlab> gitlab # [ 341.199013] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:38 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 942039vm-test-run-nixbot-gitlab> gitlab # [ 341.351487] gitaly[912]: time="2026-09-14T09:33:38.188Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7NAM6C3T6CZRVMWBHFXV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:38.153" pid=912 remote_ip="2001:db8:1::1" request_sha=fb62c37b60b550dd367e34acce88d0d3e3444d95 response_bytes=209 span.kind=server system=grpc2040vm-test-run-nixbot-gitlab> gitlab # [ 341.383423] gitaly[912]: time="2026-09-14T09:33:38.188Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=19 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7NAM6C3T6CZRVMWBHFXV grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:38.153" negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2041vm-test-run-nixbot-gitlab> gitlab # [ 341.417212] gitlab-workhorse[819]: time="2026-09-14T09:33:38Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=2092042vm-test-run-nixbot-gitlab> gitlab # [ 341.420706] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:38 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 209 "" "git/2.55.0" 1852043vm-test-run-nixbot-gitlab> gitlab # [ 341.424077] gitaly[912]: time="2026-09-14T09:33:38.189Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=28 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=1101 command.oublock=0 command.real_time_ms=30 command.spawn_token_fork_ms=2 command.system_time_ms=19 command.user_time_ms=9 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7NAM6C3T6CZRVMWBHFXV grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=20 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:38.153" grpc.time_ms=35.059 negotiation.command=fetch negotiation.filter="blob:none" negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=1 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2044vm-test-run-nixbot-gitlab> gitlab # [ 341.539030] gitaly[912]: time="2026-09-14T09:33:38.375Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7NK8PBW6P786VVG9AHG1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:34:08.073" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:33:38.374" grpc.time_ms=1.183 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2045vm-test-run-nixbot-gitlab> gitlab # [ 341.613362] gitaly[912]: time="2026-09-14T09:33:38.450Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=587 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=6 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FM7NK8PBW6P786VVG9AHG1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListBranchNamesContainingCommit grpc.request.deadline="2026-09-14T09:34:08.130" grpc.request.fullMethod=/gitaly.RefService/ListBranchNamesContainingCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=8 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:33:38.430" grpc.time_ms=19.267 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2046vm-test-run-nixbot-gitlab> gitlab # [ 341.669142] gitaly[912]: time="2026-09-14T09:33:38.505Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FM7NK8PBW6P786VVG9AHG1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:33:48.009" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:33:38.489" grpc.time_ms=15.936 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2047vm-test-run-nixbot-gitlab> gitlab # [ 341.704558] gitaly[912]: time="2026-09-14T09:33:38.538Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=574 command.oublock=0 command.real_time_ms=12 command.spawn_token_fork_ms=2 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FM7NK8PBW6P786VVG9AHG1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:33:48.043" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=136 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=63 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:33:38.523" grpc.time_ms=14.692 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2048vm-test-run-nixbot-gitlab> gitlab # [ 341.831329] gitaly[912]: time="2026-09-14T09:33:38.668Z" level=info msg="finished unary call with code OK" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7NK8PBW6P786VVG9AHG1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=ObjectFormat grpc.request.deadline="2026-09-14T09:33:48.186" grpc.request.fullMethod=/gitaly.RepositoryService/ObjectFormat grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=123 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:38.667" grpc.time_ms=0.62 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2049vm-test-run-nixbot-gitlab> gitlab # [ 341.873774] gitaly[912]: time="2026-09-14T09:33:38.710Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=14 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=571 command.oublock=0 command.real_time_ms=16 command.spawn_token_fork_ms=4 command.system_time_ms=14 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7NK8PBW6P786VVG9AHG1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=RefExists grpc.request.deadline="2026-09-14T09:33:48.210" grpc.request.fullMethod=/gitaly.RefService/RefExists grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=182 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:33:38.691" grpc.time_ms=18.68 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2050vm-test-run-nixbot-gitlab> gitlab # [ 341.944577] gitaly[912]: time="2026-09-14T09:33:38.781Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FM7NK8PBW6P786VVG9AHG1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4154 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:33:38.779" grpc.time_ms=1.463 pid=912 span.kind=server system=grpc2051vm-test-run-nixbot-gitlab> gitlab # [ 341.996397] gitaly[912]: time="2026-09-14T09:33:38.833Z" level=info msg="finished streaming call with code OK" component=gitaly.StreamServerInterceptor correlation_id=01M2FM7NK8PBW6P786VVG9AHG1 grpc.code=OK grpc.meta.client_name=gitaly-hooks grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=bidi_stream grpc.method=ReferenceTransactionHook grpc.request.fullMethod=/gitaly.HookService/ReferenceTransactionHook grpc.request.glProjectPath= grpc.request.glRepository= grpc.request.payload_bytes=4156 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=2 grpc.service=gitaly.HookService grpc.start_time="2026-09-14T09:33:38.832" grpc.time_ms=0.949 pid=912 span.kind=server system=grpc2052vm-test-run-nixbot-gitlab> gitlab # [ 342.025673] gitaly[912]: time="2026-09-14T09:33:38.851Z" level=info msg="diskcache state change" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7NK8PBW6P786VVG9AHG1 diskcache=53193dba-e121-4230-92c4-e6ee68e14438 grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T09:33:48.234" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:38.715" pid=912 ref=refs/keep-around/31d0076c6dbeb4388a79a546ec950137e948730a remote_ip="2001:db8:1::1" revision=31d0076c6dbeb4388a79a546ec950137e948730a span.kind=server system=grpc username=root2053vm-test-run-nixbot-gitlab> gitlab # [ 342.052107] gitaly[912]: time="2026-09-14T09:33:38.852Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=124 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=5340 command.oublock=8 command.real_time_ms=128 command.spawn_token_fork_ms=2 command.system_time_ms=71 command.user_time_ms=53 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7NK8PBW6P786VVG9AHG1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=mutator grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=WriteRef grpc.request.deadline="2026-09-14T09:33:48.234" grpc.request.fullMethod=/gitaly.RepositoryService/WriteRef grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=224 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RepositoryService grpc.start_time="2026-09-14T09:33:38.715" grpc.time_ms=136.445 pid=912 ref=refs/keep-around/31d0076c6dbeb4388a79a546ec950137e948730a remote_ip="2001:db8:1::1" revision=31d0076c6dbeb4388a79a546ec950137e948730a span.kind=server system=grpc username=root2054vm-test-run-nixbot-gitlab> gitlab # [ 342.076648] gitaly[912]: time="2026-09-14T09:33:38.859Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM7NK8PBW6P786VVG9AHG1 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:34:08.557" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:33:38.858" grpc.time_ms=0.786 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2055vm-test-run-nixbot-gitlab> gitlab # [ 342.305447] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:39 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/31d0076c6dbeb4388a79a546ec950137e948730a HTTP/1.1" 201 637 "" "python-httpx/0.28.1" 8602056vm-test-run-nixbot-gitlab> gitlab # [ 342.314344] nixbot[3549]: {"ts": "2026-09-14T09:33:39.142Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/31d0076c6dbeb4388a79a546ec950137e948730a \"HTTP/1.1 201 Created\""}2057vm-test-run-nixbot-gitlab> gitlab # [ 342.323061] nixbot[3549]: {"ts": "2026-09-14T09:33:39.154Z", "level": "info", "logger": "nixbot.flake_prefetch", "msg": "prefetching flake inputs", "flake_dir": "/var/lib/nixbot/worktrees/1-31d0076c6dbe-0"}2058vm-test-run-nixbot-gitlab> gitlab # [ 342.621643] nixbot[3549]: {"ts": "2026-09-14T09:33:39.458Z", "level": "info", "logger": "nixbot.nix_eval", "msg": "starting evaluation", "worktree": "/var/lib/nixbot/worktrees/1-31d0076c6dbe-0", "argv0": "bwrap"}2059vm-test-run-nixbot-gitlab> gitlab # [ 342.785696] systemd[1]: Started Nix Daemon.2060vm-test-run-nixbot-gitlab> gitlab # [ 342.897676] nix-daemon[3717]: accepted connection from pid 3712, user nixbot2061vm-test-run-nixbot-gitlab> gitlab # [ 348.147158] nix-daemon[3717]: accepted connection from pid 3767, user nixbot2062vm-test-run-nixbot-gitlab> gitlab # [ 348.174957] nix-daemon[3717]: accepted connection from pid 3712, user nixbot2063vm-test-run-nixbot-gitlab> gitlab # [ 352.682495] nix-daemon[3717]: accepted connection from pid 3712, user nixbot2064vm-test-run-nixbot-gitlab> gitlab # [ 352.912940] gitaly[912]: time="2026-09-14T09:33:49.748Z" level=info msg="finished unary call with code OK" catfile.duration_ms=6 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=6 catfile.request_object_count=1 catfile.request_object_ms=0 command.spawn_token_fork_ms=1 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM80N9VM3H2TDJAY8YY6BB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:34:19.037" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:33:49.738" grpc.time_ms=9.796 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2065vm-test-run-nixbot-gitlab> gitlab # [ 353.185565] gitaly[912]: time="2026-09-14T09:33:50.022Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FM80N9VM3H2TDJAY8YY6BB grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:34:00.005" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:33:50.006" grpc.time_ms=15.852 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2066vm-test-run-nixbot-gitlab> gitlab # [ 353.351020] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/31d0076c6dbeb4388a79a546ec950137e948730a HTTP/1.1" 201 676 "" "python-httpx/0.28.1" 5762067vm-test-run-nixbot-gitlab> gitlab # [ 353.355405] nixbot[3549]: {"ts": "2026-09-14T09:33:50.189Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/31d0076c6dbeb4388a79a546ec950137e948730a \"HTTP/1.1 201 Created\""}2068vm-test-run-nixbot-gitlab> gitlab # [ 353.426783] gitaly[912]: time="2026-09-14T09:33:50.263Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM817P937Y7B0AQX3DBJ1R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:34:20.060" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:33:50.262" grpc.time_ms=1.21 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2069vm-test-run-nixbot-gitlab> gitlab # [ 353.494940] gitaly[912]: time="2026-09-14T09:33:50.331Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=8 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=9 command.spawn_token_fork_ms=2 command.system_time_ms=4 command.user_time_ms=4 component=gitaly.StreamServerInterceptor correlation_id=01M2FM817P937Y7B0AQX3DBJ1R grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:34:00.008" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:33:50.319" grpc.time_ms=12.332 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2070vm-test-run-nixbot-gitlab> gitlab # [ 353.601826] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/31d0076c6dbeb4388a79a546ec950137e948730a HTTP/1.1" 201 635 "" "python-httpx/0.28.1" 2402071vm-test-run-nixbot-gitlab> gitlab # [ 353.611116] nixbot[3549]: {"ts": "2026-09-14T09:33:50.440Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/31d0076c6dbeb4388a79a546ec950137e948730a \"HTTP/1.1 201 Created\""}2072vm-test-run-nixbot-gitlab> gitlab # [ 353.694410] gitaly[912]: time="2026-09-14T09:33:50.531Z" level=info msg="finished unary call with code OK" catfile.duration_ms=0 catfile.flush_count=1 catfile.flush_ms=0 catfile.read_object_count=1 catfile.read_object_ms=0 catfile.request_object_count=1 catfile.request_object_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM81FR2S3C7N5ZC38Y57S2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=FindCommit grpc.request.deadline="2026-09-14T09:34:20.329" grpc.request.fullMethod=/gitaly.CommitService/FindCommit grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=165 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=204 grpc.service=gitaly.CommitService grpc.start_time="2026-09-14T09:33:50.529" grpc.time_ms=1.141 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2073vm-test-run-nixbot-gitlab> gitlab # [ 353.791817] gitaly[912]: time="2026-09-14T09:33:50.628Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=572 command.oublock=0 command.real_time_ms=13 command.spawn_token_fork_ms=2 command.system_time_ms=12 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FM81FR2S3C7N5ZC38Y57S2 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-web grpc.meta.deadline_type=regular grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=ListRefs grpc.request.deadline="2026-09-14T09:34:00.002" grpc.request.fullMethod=/gitaly.RefService/ListRefs grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=135 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=0 grpc.service=gitaly.RefService grpc.start_time="2026-09-14T09:33:50.612" grpc.time_ms=15.669 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc username=root2074vm-test-run-nixbot-gitlab> gitlab # [ 353.893309] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:50 +0000] "POST /api/v4/projects/root%2Ftest-flake/statuses/31d0076c6dbeb4388a79a546ec950137e948730a HTTP/1.1" 201 656 "" "python-httpx/0.28.1" 2732075vm-test-run-nixbot-gitlab> gitlab # [ 353.911848] nixbot[3549]: {"ts": "2026-09-14T09:33:50.739Z", "level": "info", "logger": "httpx", "msg": "HTTP Request: POST http://gitlab/api/v4/projects/root%2Ftest-flake/statuses/31d0076c6dbeb4388a79a546ec950137e948730a \"HTTP/1.1 201 Created\""}2076vm-test-run-nixbot-gitlab> gitlab # [ 354.519074] gitaly[912]: time="2026-09-14T09:33:51.354Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=12 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=580 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=6 command.user_time_ms=6 component=gitaly.StreamServerInterceptor correlation_id=01M2FM8283JYJNWQCFVYPY147B grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=188 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:51.335" grpc.time_ms=18.899 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2077vm-test-run-nixbot-gitlab> gitlab # [ 354.521119] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1202078vm-test-run-nixbot-gitlab> gitlab # [ 354.683558] gitaly[912]: time="2026-09-14T09:33:51.520Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM82D5ESHD115SYFES5VVJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:51.501" pid=912 remote_ip="2001:db8:1::1" request_sha=5d0ec876faced1ba584eb2e9d074c7a086d3e6eb response_bytes=67 span.kind=server system=grpc2079vm-test-run-nixbot-gitlab> gitlab # [ 354.705959] gitaly[912]: time="2026-09-14T09:33:51.520Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM82D5ESHD115SYFES5VVJ grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:51.501" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2080vm-test-run-nixbot-gitlab> gitlab # [ 354.726846] gitlab-workhorse[819]: time="2026-09-14T09:33:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672081vm-test-run-nixbot-gitlab> gitlab # [ 354.729502] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1252082vm-test-run-nixbot-gitlab> gitlab # [ 354.732025] gitaly[912]: time="2026-09-14T09:33:51.522Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=13 command.user_time_ms=0 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM82D5ESHD115SYFES5VVJ grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=6 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:51.501" grpc.time_ms=20.286 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2083vm-test-run-nixbot-gitlab> gitlab # [ 354.870829] gitaly[912]: time="2026-09-14T09:33:51.707Z" level=info msg="finished streaming call with code OK" command.count=2 command.cpu_time_ms=10 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=577 command.oublock=0 command.real_time_ms=11 command.spawn_token_fork_ms=1 command.system_time_ms=10 command.user_time_ms=0 component=gitaly.StreamServerInterceptor correlation_id=01M2FM82KNRVSPF44XSY9KVRS8 grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=server_stream grpc.method=InfoRefsUploadPack grpc.request.fullMethod=/gitaly.SmartHTTPService/InfoRefsUploadPack grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=186 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:51.694" grpc.time_ms=12.924 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2084vm-test-run-nixbot-gitlab> gitlab # [ 354.886151] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:51 +0000] "GET /root/test-flake.git/info/refs?service=git-upload-pack HTTP/1.1" 200 161 "" "git/2.55.0" 1022085vm-test-run-nixbot-gitlab> gitlab # [ 354.972688] gitaly[912]: time="2026-09-14T09:33:51.809Z" level=info msg="request details" component=gitaly.UnaryServerInterceptor correlation_id=01M2FM82PYMG1DN4XNB37K5BBE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:51.790" pid=912 remote_ip="2001:db8:1::1" request_sha=7eb636c121e24c8525ce835f83e5adc54479211e response_bytes=67 span.kind=server system=grpc2086vm-test-run-nixbot-gitlab> gitlab # [ 355.002623] gitaly[912]: time="2026-09-14T09:33:51.809Z" level=info msg="packfile negotiation complete" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM82PYMG1DN4XNB37K5BBE grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:51.790" negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2087vm-test-run-nixbot-gitlab> gitlab # [ 355.030695] gitlab-workhorse[819]: time="2026-09-14T09:33:51Z" level=info msg=git_traffic project_id=1 root_namespace_id=1 service=git-upload-pack written_bytes=672088vm-test-run-nixbot-gitlab> gitlab # [ 355.033819] gitlab-workhorse[819]: gitlab 2001:db8:1::1 - - [2026/09/14:09:33:51 +0000] "POST /root/test-flake.git/git-upload-pack HTTP/1.1" 200 67 "" "git/2.55.0" 1002089vm-test-run-nixbot-gitlab> gitlab # [ 355.036925] gitaly[912]: time="2026-09-14T09:33:51.810Z" level=info msg="finished unary call with code OK" command.count=2 command.cpu_time_ms=13 command.inblock=0 command.majflt=0 command.maxrssanon_bytes=0 command.minflt=585 command.oublock=0 command.real_time_ms=15 command.spawn_token_fork_ms=2 command.system_time_ms=0 command.user_time_ms=13 component=gitaly.UnaryServerInterceptor correlation_id=01M2FM82PYMG1DN4XNB37K5BBE grpc.code=OK grpc.meta.auth_version=v2 grpc.meta.client_name=gitlab-workhorse grpc.meta.deadline_type=none grpc.meta.method_operation=accessor grpc.meta.method_scope=repository grpc.meta.method_type=unary grpc.method=PostUploadPackWithSidechannel grpc.request.fullMethod=/gitaly.SmartHTTPService/PostUploadPackWithSidechannel grpc.request.glProjectPath=root/test-flake grpc.request.glRepository=project-1 grpc.request.payload_bytes=134 grpc.request.repoPath=@hashed/6b/86/6b86b273ff34fce19d6b804eff5a3f5747ada4eaa22f1d49c01e52ddb7875b4b.git grpc.request.repoStorage=default grpc.response.payload_bytes=7 grpc.service=gitaly.SmartHTTPService grpc.start_time="2026-09-14T09:33:51.790" grpc.time_ms=19.193 negotiation.command=ls-refs negotiation.haves=0 negotiation.user_agent=git/2.55.0-Linux negotiation.wants=0 pid=912 remote_ip="2001:db8:1::1" span.kind=server system=grpc2090vm-test-run-nixbot-gitlab> gitlab # [ 370.308048] sidekiq-cluster[3421]: 2026-09-14T09:34:07.143Z pid=3421 tid=yr9 INFO: {:message=>"started", :memwd_handler_class=>"Gitlab::Memory::Watchdog::Handlers::SidekiqHandler", :memwd_sleep_time_s=>3, :pid=>3421, :worker_id=>"sidekiq_0", :memwd_rss_bytes=>424349696}2091vm-test-run-nixbot-gitlab> gitlab # [ 370.599968] sidekiq-cluster[3421]: W, [2026-09-14T09:34:07.436703 #3421] WARN -- sentry: `enable_tracing` is now deprecated in favor of `traces_sample_rate = 1.0`.2092vm-test-run-nixbot-gitlab> gitlab # [ 370.738133] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-09-14T09:34:07.574Z","message":"Listening on queues [\"default,1\", \"mailers,1\"]"}2093vm-test-run-nixbot-gitlab> gitlab # [ 373.700203] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-09-14T09:34:10.535Z","message":"GitLab reliable fetch activated!"}2094vm-test-run-nixbot-gitlab> gitlab # [ 373.700587] sidekiq-cluster[3421]: {"severity":"INFO","time":"2026-09-14T09:34:10.536Z","message":"Sidekiq 7.3.9 connecting to Redis with options {:size=\u003e6, :pool_name=\u003e\"internal\", :path=\u003e\"/run/gitlab/redis.sock\", :custom=\u003e{:instrumentation_class=\u003e\"Queues\"}, :url=\u003enil}"}